-- Logs begin at Fri 2022-06-24 23:05:53 UTC, end at Sat 2022-06-25 00:11:47 UTC. -- Jun 24 23:40:09.731860 dv-cinder-847624-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 23:40:09.741245 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 23:40:09 2022] *** Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: nodename: dv-cinder-847624-1-iscsi Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: machine: x86_64 Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: clock source: unix Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: pcre jit disabled Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: detected number of CPU cores: 4 Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: current working directory: / Jun 24 23:40:09.743132 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: detected binary path: /usr/bin/uwsgi-core Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: your processes number limit is 47680 Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: your memory page size is 4096 bytes Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: detected max file descriptor number: 2048 Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: lock engine: pthread robust mutexes Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: thunder lock: enabled Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 23:40:09.743787 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 23:40:09.788713 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: Python main interpreter initialized at 0x56052af189c0 Jun 24 23:40:09.788713 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: python threads support enabled Jun 24 23:40:09.788713 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: your server socket listen backlog is limited to 100 connections Jun 24 23:40:09.788713 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: your mercy for graceful operations on workers is 90 seconds Jun 24 23:40:09.789041 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 23:40:09.789114 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: *** Operational MODE: preforking *** Jun 24 23:40:09.789358 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: *** uWSGI is running in multiple interpreter mode *** Jun 24 23:40:09.789358 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: spawned uWSGI master process (pid: 109605) Jun 24 23:40:09.789536 dv-cinder-847624-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 23:40:09.790063 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 1 (pid: 109606, cores: 1) Jun 24 23:40:09.790392 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 2 (pid: 109607, cores: 1) Jun 24 23:40:09.790554 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 23:40:10.461360 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 23:40:10.467197 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 23:40:11.581756 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:40:11.581756 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes Jun 24 23:40:11.582431 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:40:11.582431 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes Jun 24 23:40:11.594640 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:40:11.594640 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes Jun 24 23:40:11.595079 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:40:11.595079 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes Jun 24 23:40:14.077402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 23:40:14.078037 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 23:40:14.078037 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 23:40:14.078469 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 23:40:14.078554 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 23:40:14.078646 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 23:40:14.078726 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 23:40:14.078812 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 23:40:14.078904 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 23:40:14.079013 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 23:40:14.079119 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.079235 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.079432 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.079558 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.079732 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.079916 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080047 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080241 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080374 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080571 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080710 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.080971 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081113 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081331 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081438 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081652 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081754 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.081906 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082001 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082214 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082534 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847624-1-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082635 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082849 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.082935 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847624-1-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083150 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083244 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083452 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083547 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083755 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.083840 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.084564 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.084679 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.084900 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.085007 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.085198 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.085283 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.085507 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.085865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086006 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086318 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086443 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086618 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086711 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.086922 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087025 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087253 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087352 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087561 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087650 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087863 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.087960 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088177 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088267 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088479 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088576 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088823 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.088913 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089124 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089235 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089517 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847624-1-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089608 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847624-1-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089829 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.089919 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090224 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090441 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090529 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090860 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.090994 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091142 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091273 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091447 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091564 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091757 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.091855 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092072 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092170 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092373 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092476 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092714 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.092827 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093026 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093121 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093336 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093441 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093646 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093731 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.093938 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094023 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094238 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094332 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094538 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094624 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094849 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.094942 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095145 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095231 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095441 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095525 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095688 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095773 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.095986 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096072 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096398 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096645 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096744 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.096966 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097063 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097215 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097303 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097462 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097558 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097774 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.097867 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098086 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098185 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098392 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098479 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098689 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098781 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.098987 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.099080 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.099335 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.099428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.099580 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.100258 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.100451 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.100782 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.100938 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101087 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101255 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101399 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101569 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101714 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.101887 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102028 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102199 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102329 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102522 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102641 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.102827 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103029 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103145 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103276 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103538 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103637 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103790 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.103884 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104094 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104180 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104431 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104620 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104770 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.104868 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105074 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105160 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105388 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105492 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105693 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105779 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.105993 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106079 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106290 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106384 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106591 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106678 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106902 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.106985 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107148 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107235 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107442 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107527 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107741 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.107828 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108036 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108122 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108335 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108421 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108652 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108741 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.108958 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109056 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109251 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109338 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109548 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109640 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109845 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.109943 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110145 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110229 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110442 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110535 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110739 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.110885 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111036 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111129 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111331 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111429 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111633 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111735 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.111930 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112021 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112231 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112337 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112530 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112641 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112862 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.112953 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113152 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113269 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113452 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113538 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113750 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.113835 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114047 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114146 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114348 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114450 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114644 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114729 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.114950 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115044 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115271 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115383 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115594 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115704 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.115892 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116042 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116180 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116303 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116478 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116565 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116820 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.116921 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117118 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117266 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117421 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117521 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117735 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.117822 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118036 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118128 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118337 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118424 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118635 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118722 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.118934 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119027 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119230 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119316 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119526 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119659 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119821 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.119906 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120117 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120201 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120409 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120506 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120734 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.120832 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121032 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121127 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121338 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121437 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121638 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121745 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.121939 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122046 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122234 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122318 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122532 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122618 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.122849 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:40:14.122943 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123181 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123266 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123496 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123582 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123822 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.123917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124133 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124217 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124448 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124532 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124780 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.124875 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125090 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125182 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125399 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125492 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125707 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.125799 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126009 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126110 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126315 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126408 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126619 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126706 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.126925 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127010 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127242 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127421 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127549 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127636 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127858 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.127944 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128166 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128260 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128468 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128555 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128802 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.128898 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129106 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129199 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129419 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129507 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129721 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.129807 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130048 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130142 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130358 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130453 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130677 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.130762 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.131508 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.131620 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.131823 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.131911 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132130 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132228 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132429 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132526 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132757 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.132846 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133062 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133147 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133367 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133463 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133675 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133762 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.133989 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134083 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134293 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134380 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134595 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134689 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134896 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.134984 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135199 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135294 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135502 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135591 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135807 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.135893 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136118 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136206 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136426 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136511 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136754 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.136842 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137068 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137163 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137373 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137458 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137675 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137771 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.137978 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138064 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138276 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138362 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138574 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138668 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138871 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.138957 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139171 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139256 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139468 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139561 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139772 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.139908 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140072 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140166 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140373 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140468 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140722 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.140823 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141021 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141106 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141327 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141632 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141719 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.141933 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142017 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142232 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142321 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142537 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142621 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142838 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.142935 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143137 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143224 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143440 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143532 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143740 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.143832 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.144038 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.144132 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.144344 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.144737 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.144913 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145000 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145210 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145306 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145514 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145608 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145814 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.145914 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146121 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146207 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146423 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146509 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146791 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.146888 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147099 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147192 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147404 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147490 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147719 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.147814 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148028 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148114 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148334 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148419 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148692 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.148784 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149024 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149110 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149326 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149425 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149647 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149734 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.149947 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150033 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150254 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150348 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150549 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150636 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150847 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.150931 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151143 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151240 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151442 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151530 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151737 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.151829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152035 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152130 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152330 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152415 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152647 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152736 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.152947 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153045 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153242 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153334 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153539 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153625 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.153841 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154006 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154140 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154227 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154522 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154733 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.154833 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155028 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155115 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155362 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155449 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155663 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155757 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.155996 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156088 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156313 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156400 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156641 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156732 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.156957 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157041 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157258 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157343 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157562 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157657 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157864 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.157949 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158166 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158250 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158469 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158554 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158771 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.158856 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159086 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159172 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159389 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159475 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159700 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.159787 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160003 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160155 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160316 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160403 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160635 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160723 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.160948 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161045 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161244 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161329 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161552 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161638 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161882 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.161978 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.162720 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.162812 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163036 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163248 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163398 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163623 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163722 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.163935 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164022 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164243 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164340 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164551 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164698 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164880 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.164968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165192 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165289 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165499 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165586 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165801 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.165886 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166103 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166203 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166406 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166492 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166719 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.166805 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167023 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167121 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167319 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167405 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167620 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167704 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.167929 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168029 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168252 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168345 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168707 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168881 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.168977 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169190 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169292 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169489 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169588 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169792 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.169880 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170095 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170226 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170395 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170488 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170693 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170780 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.170993 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171078 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171294 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171386 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171594 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171689 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171894 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.171987 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172188 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172282 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172485 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172571 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172808 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.172894 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173106 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173203 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173401 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173487 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173700 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.173796 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174005 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174101 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174306 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174398 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174612 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174698 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.174924 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175022 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175223 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175317 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175520 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175607 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175818 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.175905 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176121 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176212 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176425 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176511 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176747 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.176835 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177044 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177140 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177340 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177425 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177672 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.177825 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178089 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178176 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178585 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178733 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.178829 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179042 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179137 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179352 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179447 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179653 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179750 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.179956 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180042 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180261 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180567 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180695 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180891 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.180979 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181196 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181295 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181497 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181596 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181800 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.181887 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182103 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182206 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182409 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182496 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182710 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.182795 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183015 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183105 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183319 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183411 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183616 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183701 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.183914 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.184000 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.184307 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.184533 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.184804 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185115 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185218 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185425 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185519 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185735 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.185822 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186046 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186133 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186360 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186455 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186667 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186763 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.186988 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187073 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187305 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187399 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187610 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187709 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.187911 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188011 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188208 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188296 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188505 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188636 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.188916 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189125 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189213 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189424 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189518 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189721 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.189819 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190019 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190105 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190316 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190403 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190612 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190707 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.190928 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191039 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191202 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191287 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191500 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191596 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191795 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.191881 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192091 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192184 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192385 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192484 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192703 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.192792 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.193012 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.193098 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.193310 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.193929 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194119 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194213 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194416 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194515 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194715 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.194812 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195051 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195182 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195352 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195438 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195682 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.195771 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196003 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196089 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196403 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196620 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196709 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.196944 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197029 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197242 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197386 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197542 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197630 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197838 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.197931 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198136 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198239 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198438 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198526 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198740 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.198833 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199035 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199131 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199338 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199426 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199646 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199733 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.199951 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200054 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200251 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200345 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200548 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200684 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200868 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.200956 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201163 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201251 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201468 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201554 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201766 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.201854 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202061 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202147 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202358 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202447 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202655 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202741 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.202952 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203039 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203246 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203330 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203538 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203632 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.203917 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204132 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204232 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204513 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204746 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.204845 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205045 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205140 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205345 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205438 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205641 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205728 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.205936 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206031 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206248 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206335 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206546 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206639 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.206840 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207002 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207138 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207226 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207431 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207516 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207726 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.207813 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208022 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208117 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208327 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208414 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208653 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208755 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.208952 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209150 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209299 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209575 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209729 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209851 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.209939 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210161 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210345 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210466 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210654 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210774 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.210961 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211077 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211262 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211378 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211563 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211679 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211862 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.211980 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212161 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212279 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212461 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212612 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212805 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.212903 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213111 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213212 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213412 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213499 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213712 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.213805 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214010 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214106 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214346 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214433 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214647 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214741 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.214998 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215086 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215298 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215388 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215607 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215702 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215910 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.215997 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.216212 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.216297 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.216515 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.216633 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.216849 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217011 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217148 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217322 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217460 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217630 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217765 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.217939 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218071 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218238 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218370 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218540 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218669 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218858 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.218983 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219162 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219293 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219468 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219595 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219783 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.219910 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220098 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220224 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220412 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220540 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220738 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.220861 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221042 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221165 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221346 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221470 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221648 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221771 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.221953 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222074 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222255 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222377 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222559 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222681 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222863 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.222985 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223168 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223290 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223472 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223597 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223776 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.223900 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.224078 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.224200 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.224380 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.224502 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.225240 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.225383 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.225745 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.225832 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226073 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226160 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226384 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226484 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226685 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226772 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.226988 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227073 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227288 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227375 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227590 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227676 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227886 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.227971 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.228303 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.228391 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.228632 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.228743 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.228941 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229034 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229239 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229332 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229542 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229633 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229843 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.229933 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230150 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230259 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230455 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230551 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230757 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.230853 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231158 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231248 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231462 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231766 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.231869 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232070 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232159 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232367 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232477 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232687 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232804 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.232995 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233092 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233311 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233398 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233610 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233709 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233906 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.233992 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234202 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234288 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234514 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234601 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234812 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.234910 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235125 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235211 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235527 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235625 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.235914 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236124 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236217 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236527 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236662 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236859 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.236947 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237162 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237260 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237475 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237560 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237789 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.237864 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238103 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238198 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238399 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238505 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238704 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.238792 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239003 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239089 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239321 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239421 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239634 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239721 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.239934 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.240021 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.240259 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.240358 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241164 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241255 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241494 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241619 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241815 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.241943 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242124 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242253 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242441 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242576 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242849 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.242989 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243168 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243310 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243470 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243617 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243787 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.243935 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244107 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244257 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244408 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244733 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.244869 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245041 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245177 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245341 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245478 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245643 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245779 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.245963 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246097 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246264 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246396 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246570 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246702 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.246874 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247010 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247178 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247340 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247479 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247599 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247777 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.247896 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248097 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248396 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248482 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248743 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.248847 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249062 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249159 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249380 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249467 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249696 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249791 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.249998 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250094 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250317 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250417 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250619 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250706 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.250916 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251003 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251211 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251299 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251507 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251601 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251843 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.251930 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252141 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252271 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252455 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252542 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252800 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.252888 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253123 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253209 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253427 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253512 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253754 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.253848 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254069 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254156 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254378 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254473 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254692 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.254778 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255008 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255094 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255309 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255408 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255605 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255691 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.255941 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256032 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256316 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256415 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256639 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256731 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.256942 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257040 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257246 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257343 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257545 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257632 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257843 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.257930 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258143 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258232 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258461 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258549 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258757 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.258843 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259076 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259165 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259378 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259465 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259673 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259759 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.259971 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260059 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260265 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260351 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260619 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260718 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.260924 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261012 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261254 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261341 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261567 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261671 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261885 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.261972 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262205 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262298 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262509 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262604 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262826 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.262920 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263228 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263445 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263540 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263755 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.263842 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264060 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264146 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264368 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264463 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264697 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.264787 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265006 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265092 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265309 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265615 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265708 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.265920 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.266007 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.266227 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.266322 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.266738 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.266829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267056 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267143 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267366 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267455 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267671 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267756 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.267973 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268060 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268279 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268373 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268632 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268723 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.268908 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.269011 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.269212 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.269299 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.269780 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.269869 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270084 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270186 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270404 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270490 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270717 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.270810 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271033 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271129 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271362 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271450 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271700 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.271790 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272045 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272321 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272416 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272668 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272760 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.272986 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273084 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273333 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273420 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273637 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273724 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.273939 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274027 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274246 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274332 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274555 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274640 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274858 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.274952 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275163 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275255 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275469 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275570 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275775 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.275869 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276081 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276169 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276384 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276553 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276712 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.276809 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277021 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277110 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277334 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277429 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277653 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277741 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.277962 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278058 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278272 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278409 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278582 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278670 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278892 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.278987 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.279204 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.279402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.279710 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.279803 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280014 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280107 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280340 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280678 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280769 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.280994 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281083 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281614 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281702 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.281912 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282008 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282211 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282312 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282506 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282593 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282805 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.282901 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283104 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283192 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283398 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283486 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283710 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.283805 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284007 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284094 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284299 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284386 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284633 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284740 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.284930 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.285152 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.285453 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.285540 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.285795 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.285884 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286106 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286193 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286425 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286527 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286734 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.286828 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.287037 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.287656 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288032 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288175 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288332 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288534 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288719 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.288862 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289000 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289159 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289320 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289464 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289624 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289740 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.289837 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290060 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290210 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290355 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290498 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290641 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.290758 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291009 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291119 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291302 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291392 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291631 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.291741 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293443 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293557 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293644 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293644 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293789 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.293888 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294035 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294178 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294321 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294473 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294628 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294782 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.294923 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295072 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295072 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295348 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295482 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295585 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295668 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295668 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295809 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295886 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.295963 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296049 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296166 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296255 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296473 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296561 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296806 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.296912 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297111 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297198 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297422 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297521 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297722 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.297811 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298026 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298112 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298345 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298432 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298655 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298753 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.298965 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299052 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299310 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299396 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299622 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299710 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.299936 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300159 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300246 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300488 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300741 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300835 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.300949 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.301148 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.301472 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.301587 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.301775 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.301873 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.302076 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.302322 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.302410 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.302656 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.302822 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.303559 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.303652 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.303875 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304009 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304180 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304270 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304488 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304574 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304822 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.304921 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305123 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305211 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305426 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305513 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305733 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.305834 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306036 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306124 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306338 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306426 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306642 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306738 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.306944 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307031 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307245 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307332 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307552 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307649 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307858 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.307946 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308164 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308251 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308467 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308556 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308796 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.308896 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309099 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309186 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309496 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309707 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.309795 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310013 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310100 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310317 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310406 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310627 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310714 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.310932 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311027 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311242 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311338 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311541 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311635 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311847 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.311971 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312154 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312261 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312457 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312546 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312788 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.312892 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313112 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313200 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313417 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313554 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313718 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.313807 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314057 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314145 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314371 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314459 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314676 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.314765 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315001 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315088 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315315 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315404 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315629 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315718 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.315944 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316033 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316243 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316338 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316543 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316655 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.316952 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317168 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317269 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317481 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317569 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317785 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.317914 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318082 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318180 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318499 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318707 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.318947 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319047 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319290 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319384 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319586 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319681 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319884 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.319980 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320185 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320279 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320480 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320568 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320802 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.320902 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321099 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321185 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321395 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321489 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321691 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321787 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.321990 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322087 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322286 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322375 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322581 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322671 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322875 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.322970 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323169 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323256 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323463 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323550 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323757 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.323852 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324053 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324148 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324350 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324438 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324676 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324769 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.324977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325066 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325279 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325368 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325575 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325663 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325874 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.325970 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326170 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326257 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326494 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326640 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326806 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.326908 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327112 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327201 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327426 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327520 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327732 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.327832 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328035 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328123 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328345 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328441 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328668 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328772 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.328980 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329078 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329286 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329373 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329590 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329686 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329910 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.329997 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330208 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330295 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330509 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330597 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330813 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.330901 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331116 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331203 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331418 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331515 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331721 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.331807 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332036 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332133 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332337 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332437 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332661 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332753 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.332971 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333068 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333276 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333363 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333580 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333665 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.333884 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334007 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334220 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334389 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334541 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334750 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.334847 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335058 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335147 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335362 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335457 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335672 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335842 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.335978 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336090 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336285 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336398 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336609 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336762 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.336925 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337087 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337244 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337562 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337703 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.337865 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.338004 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.338189 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.338279 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 23:40:14.338510 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.338851 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.339158 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.339494 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.339816 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.340125 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.340433 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.340767 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:40:14.341009 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 23:40:14.491790 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Registered counter for database nova_api Jun 24 23:40:14.494737 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Registered counter for database nova_api Jun 24 23:40:14.512265 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.514992 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.518893 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.521889 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.577002 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.context [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5615ae4e-5e2b-4e7f-89df-a16968d1ea83(cell1) {{(pid=109606) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 23:40:14.579232 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.context [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5615ae4e-5e2b-4e7f-89df-a16968d1ea83(cell1) {{(pid=109607) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 23:40:14.580919 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:40:14.582494 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:40:14.583115 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:40:14.583276 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:40:14.585253 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:40:14.586041 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:40:14.586144 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:40:14.587939 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:40:14.588035 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Registered counter for database nova_cell0 Jun 24 23:40:14.589913 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Registered counter for database nova_cell0 Jun 24 23:40:14.592052 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Registered counter for database nova_cell1 Jun 24 23:40:14.593838 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Registered counter for database nova_cell1 Jun 24 23:40:14.600817 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.602026 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.606022 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.608175 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.608442 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.610690 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.613689 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.616041 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.756785 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Registered counter for database nova_cell0 Jun 24 23:40:14.763425 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.764769 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Registered counter for database nova_cell0 Jun 24 23:40:14.767770 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:14.774283 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:40:14.778604 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:40:15.102072 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:40:15.107071 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:40:15.109266 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:40:15.117932 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:40:15.445403 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:40:15.451222 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:40:15.456504 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56052af189c0 pid: 109606 (default app) Jun 24 23:40:15.456946 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:40:15.458565 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:40:15.460252 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002240 Jun 24 23:40:15.460681 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Fri Jun 24 23:40:15 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:40:15.463478 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-3b15aa21-fce6-4c1e-aad7-781cab6544c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:40:15.468736 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56052af189c0 pid: 109607 (default app) Jun 24 23:41:31.395304 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:31.396308 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 24 23:41:31.397331 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:31.415684 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:31.421087 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell1:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:31.422465 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell0:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:31.425317 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:31.866514 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-3d16395e-a921-438d-ab76-226143f490ed admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:31.896117 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-3d16395e-a921-438d-ab76-226143f490ed admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489899 Jun 24 23:41:31.897079 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jun 24 23:41:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:34.010034 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:34.011035 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0e27730b-c58d-421e-a8a0-d5faaa17f7bb None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 24 23:41:34.011424 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:34.080781 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0af818e5-790c-4d31-baaa-019926796810 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:34.102670 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:41:34.102670 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: warnings.warn(msg) Jun 24 23:41:34.132896 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0af818e5-790c-4d31-baaa-019926796810 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114984 Jun 24 23:41:34.134882 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:41:34.361068 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ed6b2e03-c5ee-4aec-b403-92ab9a55b5f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:34.363434 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:41:34.363434 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:41:34.366132 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:34.366946 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell1:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:34.368122 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:34.368860 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:41:34.435769 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ed6b2e03-c5ee-4aec-b403-92ab9a55b5f3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293133 Jun 24 23:41:34.437135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jun 24 23:41:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:36.552787 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-0af818e5-790c-4d31-baaa-019926796810 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:36.553933 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-0af818e5-790c-4d31-baaa-019926796810 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jun 24 23:41:36.554404 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:36.660286 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-549da574-f194-4419-a7f2-8f527a6adc18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:36.678125 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:41:36.678125 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:41:36.696450 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-549da574-f194-4419-a7f2-8f527a6adc18 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136176 Jun 24 23:41:36.697056 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:41:36.709175 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-f1cb7474-84d9-40e0-ab31-1aa2a76896bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:36.710659 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:41:36.710659 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: warnings.warn(msg) Jun 24 23:41:36.752112 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-f1cb7474-84d9-40e0-ab31-1aa2a76896bf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046645 Jun 24 23:41:36.752645 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jun 24 23:41:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:41:38.848722 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-549da574-f194-4419-a7f2-8f527a6adc18 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:38.850340 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-549da574-f194-4419-a7f2-8f527a6adc18 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Jun 24 23:41:38.852058 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:38.913971 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-149a9673-09fd-4dc5-8e89-4f877d775d4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:38.933202 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-149a9673-09fd-4dc5-8e89-4f877d775d4f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075870 Jun 24 23:41:38.934583 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:41:38.946868 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2ddc9024-8610-4d0f-99d0-1cdb58be766f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:38.974423 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2ddc9024-8610-4d0f-99d0-1cdb58be766f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031183 Jun 24 23:41:38.975391 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jun 24 23:41:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:41.096207 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-149a9673-09fd-4dc5-8e89-4f877d775d4f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:41.097244 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-149a9673-09fd-4dc5-8e89-4f877d775d4f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002373 Jun 24 23:41:41.097640 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:41.169328 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-7c895c29-89c6-49b1-a282-4756c06eb264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:41.188242 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-7c895c29-89c6-49b1-a282-4756c06eb264 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084856 Jun 24 23:41:41.190383 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:41:41.201691 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-9d2a9c03-a451-4eb9-904e-95a170e346a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:41.224459 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-9d2a9c03-a451-4eb9-904e-95a170e346a9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026399 Jun 24 23:41:41.225203 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jun 24 23:41:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:43.346185 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-7c895c29-89c6-49b1-a282-4756c06eb264 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:43.347192 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-7c895c29-89c6-49b1-a282-4756c06eb264 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 24 23:41:43.347599 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:43.408995 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "id": "d4"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:43.427046 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073727 Jun 24 23:41:43.427602 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:41:43.439986 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-b3f52def-1a62-4b03-b5ee-6f2377875bca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:43.463396 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-b3f52def-1a62-4b03-b5ee-6f2377875bca admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027674 Jun 24 23:41:43.464083 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jun 24 23:41:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:45.591831 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:45.592872 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 24 23:41:45.593275 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:45.654192 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3c4cdfad-1fde-4c6c-817e-b619080f565c admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:45.680756 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3c4cdfad-1fde-4c6c-817e-b619080f565c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080792 Jun 24 23:41:45.681314 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jun 24 23:41:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:41:47.787199 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:47.788219 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-67e72ad7-cfc6-4237-96e4-aa6ad815eb57 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 24 23:41:47.788644 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:41:47.852397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3b7f3837-1dde-4f9e-821c-57be90663183 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:47.871654 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3b7f3837-1dde-4f9e-821c-57be90663183 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077227 Jun 24 23:41:47.872242 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:41:47.884381 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a2627594-6c37-4f4c-8732-92b3ef48aea8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:47.910488 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a2627594-6c37-4f4c-8732-92b3ef48aea8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029577 Jun 24 23:41:47.911224 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jun 24 23:41:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:50.016754 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-3b7f3837-1dde-4f9e-821c-57be90663183 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:50.018066 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-3b7f3837-1dde-4f9e-821c-57be90663183 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jun 24 23:41:50.018478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:50.086154 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-02e8b780-1dd3-4f6d-a460-0436c77492a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:50.104424 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-02e8b780-1dd3-4f6d-a460-0436c77492a0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079783 Jun 24 23:41:50.105063 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:41:50.117523 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-17806ce8-d45d-4d2d-be37-f0da22441b15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:50.143180 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-17806ce8-d45d-4d2d-be37-f0da22441b15 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029040 Jun 24 23:41:50.143774 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jun 24 23:41:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:41:52.225018 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-02e8b780-1dd3-4f6d-a460-0436c77492a0 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:52.225957 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-02e8b780-1dd3-4f6d-a460-0436c77492a0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 24 23:41:52.226382 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:52.285978 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-9c7b22e1-11a1-4fb6-87ba-ad013cb44db0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:52.303981 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-9c7b22e1-11a1-4fb6-87ba-ad013cb44db0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071851 Jun 24 23:41:52.304540 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:41:52.317143 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-2471986e-93b7-4460-a20b-7590790c0962 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:52.340326 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-2471986e-93b7-4460-a20b-7590790c0962 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027626 Jun 24 23:41:52.340932 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jun 24 23:41:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:54.427397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-9c7b22e1-11a1-4fb6-87ba-ad013cb44db0 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:54.428416 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-9c7b22e1-11a1-4fb6-87ba-ad013cb44db0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 24 23:41:54.430597 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:54.487698 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c31c056f-bb75-489f-a994-79510bca19dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "rxtx_factor": 1.0}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:54.506916 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c31c056f-bb75-489f-a994-79510bca19dc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071371 Jun 24 23:41:54.507463 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:41:54.519428 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-6495aa15-3862-4d49-95e1-936e3297f185 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:54.549147 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-6495aa15-3862-4d49-95e1-936e3297f185 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033651 Jun 24 23:41:54.549746 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jun 24 23:41:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:41:56.665906 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c31c056f-bb75-489f-a994-79510bca19dc admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:41:56.666941 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c31c056f-bb75-489f-a994-79510bca19dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 24 23:41:56.667338 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:41:56.727349 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "ram": 16384, "disk": 160, "rxtx_factor": 1.0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:56.746649 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072394 Jun 24 23:41:56.747222 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jun 24 23:41:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:41:56.759341 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-20687141-0d1f-40c8-ba0f-685955609cfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:41:56.785229 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-20687141-0d1f-40c8-ba0f-685955609cfe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029524 Jun 24 23:41:56.785834 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jun 24 23:41:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:42:22.158878 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:22.159892 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 24 23:42:22.160293 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:22.170737 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:42:22.219669 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-ca77cc41-970c-477b-808f-d43f09b00e17 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:22.237086 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-ca77cc41-970c-477b-808f-d43f09b00e17 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071043 Jun 24 23:42:22.237622 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jun 24 23:42:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:42:23.175794 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:23.176878 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-751c40b2-d5db-4d7c-9f6b-421e0b7d8a6e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 24 23:42:23.177277 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:23.366145 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-649cb8b3-0e3c-44dc-8e0f-32c95776852d admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:23.371820 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-649cb8b3-0e3c-44dc-8e0f-32c95776852d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-649cb8b3-0e3c-44dc-8e0f-32c95776852d admin admin] Request method failure captured: Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept: application/json Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Connection: keep-alive Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Content-Length: 0 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Host: 10.222.0.47 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABitkvfzTBspppXnqmCkKaSQsq-1z7x_hEvNvRsR90wj7g0c80QwYElJ9iLFOkXyWfIJEdY4XV_zkyC3CdnYME7ciJpKhBKmUAqXPuKL_qmN1s1STrgvwW-8usOj-zZbYUeOrnbGYzMAGSVt6PjK5TaDGH0xSS2Tl5xT-TpJgqTQny_zBM Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Id: None Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Name: None Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Name: admin Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Role: admin,member,reader Jun 24 23:42:23.375047 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Roles: admin,member,reader Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant: admin Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User: admin Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Name: admin Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: method: > Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: exception: Flavor 42 could not be found. Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: action_args: {'id': '42'} Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:23.376977 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:23.378196 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-649cb8b3-0e3c-44dc-8e0f-32c95776852d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:23.380823 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-649cb8b3-0e3c-44dc-8e0f-32c95776852d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062244 Jun 24 23:42:23.380823 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jun 24 23:42:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 23:42:23.386035 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-8b03cdb8-8960-46b5-8449-2cafb16d722e admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:23.389038 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:42:23.409394 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-8b03cdb8-8960-46b5-8449-2cafb16d722e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026851 Jun 24 23:42:23.409948 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:42:23.419509 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-ca1c1170-b126-46ad-b33b-d3a36d0f389e admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:23.442325 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-ca1c1170-b126-46ad-b33b-d3a36d0f389e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026353 Jun 24 23:42:23.442859 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:42:23.454001 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e7f6fda1-3912-4cd1-8088-f49bd1895f2b admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:23.460390 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-e7f6fda1-3912-4cd1-8088-f49bd1895f2b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e7f6fda1-3912-4cd1-8088-f49bd1895f2b admin admin] Request method failure captured: Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept: application/json Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Connection: keep-alive Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Content-Length: 0 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Host: 10.222.0.47 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABitkvfzTBspppXnqmCkKaSQsq-1z7x_hEvNvRsR90wj7g0c80QwYElJ9iLFOkXyWfIJEdY4XV_zkyC3CdnYME7ciJpKhBKmUAqXPuKL_qmN1s1STrgvwW-8usOj-zZbYUeOrnbGYzMAGSVt6PjK5TaDGH0xSS2Tl5xT-TpJgqTQny_zBM Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Id: None Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Name: None Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Name: admin Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Role: admin,member,reader Jun 24 23:42:23.463628 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Roles: admin,member,reader Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant: admin Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User: admin Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Name: admin Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: method: > Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: exception: Flavor 42 could not be found. Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: action_args: {'id': '42'} Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:23.465116 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:23.465865 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:23.466833 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e7f6fda1-3912-4cd1-8088-f49bd1895f2b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:23.467829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e7f6fda1-3912-4cd1-8088-f49bd1895f2b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016422 Jun 24 23:42:23.467829 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jun 24 23:42:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 23:42:24.285410 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-ca1c1170-b126-46ad-b33b-d3a36d0f389e admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:24.286427 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-ca1c1170-b126-46ad-b33b-d3a36d0f389e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 24 23:42:24.286816 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:24.478976 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ddfd1237-e3c6-47cb-9f7d-9989c9e28ebd admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:24.485579 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-ddfd1237-e3c6-47cb-9f7d-9989c9e28ebd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ddfd1237-e3c6-47cb-9f7d-9989c9e28ebd admin admin] Request method failure captured: Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept: application/json Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Connection: keep-alive Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Content-Length: 0 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Host: 10.222.0.47 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABitkvgGML0K9yuwKgXTKmlPpjgS7Cwth8HynmBPfMOdMUpyOMZ6emgLCo5UyP_udFtefpchrqQVw79_xxs5G4r53FG7m9p0_OHS1l9zfFC8m0RYRYH-rpA3WPD7lmS809TleDKioR33ILM_c_lA6Q2FB5YrXiiqY2ec9XxJxaiZ7M12cs Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Id: None Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Name: None Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Name: admin Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Role: admin,member,reader Jun 24 23:42:24.486879 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Roles: admin,member,reader Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant: admin Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User: admin Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Name: admin Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: method: > Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: exception: Flavor 84 could not be found. Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: action_args: {'id': '84'} Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:24.488093 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:24.488917 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.490135 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ddfd1237-e3c6-47cb-9f7d-9989c9e28ebd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:24.491368 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ddfd1237-e3c6-47cb-9f7d-9989c9e28ebd admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060907 Jun 24 23:42:24.491368 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jun 24 23:42:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 23:42:24.497774 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-77f23545-2c6d-4d2f-af2a-1a48558879f1 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:24.511846 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-77f23545-2c6d-4d2f-af2a-1a48558879f1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017641 Jun 24 23:42:24.512408 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:42:24.521782 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-f24933d7-2f2d-4b71-8533-608e5858167a admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:24.536958 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-f24933d7-2f2d-4b71-8533-608e5858167a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018876 Jun 24 23:42:24.537497 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:42:24.546710 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a6c23ea4-72f9-4b76-acec-6985f4e9673b admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:24.552531 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-a6c23ea4-72f9-4b76-acec-6985f4e9673b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a6c23ea4-72f9-4b76-acec-6985f4e9673b admin admin] Request method failure captured: Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept: application/json Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Connection: keep-alive Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Content-Length: 0 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Host: 10.222.0.47 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABitkvgGML0K9yuwKgXTKmlPpjgS7Cwth8HynmBPfMOdMUpyOMZ6emgLCo5UyP_udFtefpchrqQVw79_xxs5G4r53FG7m9p0_OHS1l9zfFC8m0RYRYH-rpA3WPD7lmS809TleDKioR33ILM_c_lA6Q2FB5YrXiiqY2ec9XxJxaiZ7M12cs Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Id: None Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Name: None Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Name: admin Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Role: admin,member,reader Jun 24 23:42:24.554048 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Roles: admin,member,reader Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant: admin Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User: admin Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Name: admin Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: method: > Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: exception: Flavor 84 could not be found. Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: action_args: {'id': '84'} Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:24.555553 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:24.556926 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:24.558301 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a6c23ea4-72f9-4b76-acec-6985f4e9673b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:24.559490 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a6c23ea4-72f9-4b76-acec-6985f4e9673b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012211 Jun 24 23:42:24.559490 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jun 24 23:42:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 23:42:25.395356 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-f24933d7-2f2d-4b71-8533-608e5858167a admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:25.396366 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-f24933d7-2f2d-4b71-8533-608e5858167a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 24 23:42:25.396802 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:25.588475 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c175206d-0e5e-490a-9882-51fbd407a3f6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:25.594282 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-c175206d-0e5e-490a-9882-51fbd407a3f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c175206d-0e5e-490a-9882-51fbd407a3f6 admin admin] Request method failure captured: Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept: application/json Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Connection: keep-alive Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Content-Length: 0 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Host: 10.222.0.47 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABitkvhv3NpCxv2l4YGSap0pDaQhb9amvdN50lRYeNbQd8Cja5mCc-DbO-kmmLVb-Y9WqV3qEUwwTaU33KWjOAmppf4QcKvCaxj5x6aW1zgib7C9-s2ANzV48Al1PTkfMcEq5J36L4svXS3p8DPNM6R7G0eIPSOAbssNAdU6D_9PxZUFZo Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Id: None Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Domain-Name: None Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Project-Name: admin Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Role: admin,member,reader Jun 24 23:42:25.595797 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Roles: admin,member,reader Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant: admin Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User: admin Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: X-User-Name: admin Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: method: > Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: exception: Flavor 451 could not be found. Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: action_args: {'id': '451'} Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:25.597358 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:25.598302 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.599550 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c175206d-0e5e-490a-9882-51fbd407a3f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:25.600848 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c175206d-0e5e-490a-9882-51fbd407a3f6 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060154 Jun 24 23:42:25.600848 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:42:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 23:42:25.609507 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-aeebff1e-cd6d-43b8-b110-b24d583d8dc3 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:25.622861 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-aeebff1e-cd6d-43b8-b110-b24d583d8dc3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016834 Jun 24 23:42:25.623380 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:42:25.633254 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:25.647740 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017998 Jun 24 23:42:25.648271 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jun 24 23:42:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:42:25.657887 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fb1dfc1f-c70b-4846-88af-64aa6376e4e8 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:25.663465 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-fb1dfc1f-c70b-4846-88af-64aa6376e4e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fb1dfc1f-c70b-4846-88af-64aa6376e4e8 admin admin] Request method failure captured: Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept: application/json Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Connection: keep-alive Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Content-Length: 0 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Host: 10.222.0.47 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABitkvhv3NpCxv2l4YGSap0pDaQhb9amvdN50lRYeNbQd8Cja5mCc-DbO-kmmLVb-Y9WqV3qEUwwTaU33KWjOAmppf4QcKvCaxj5x6aW1zgib7C9-s2ANzV48Al1PTkfMcEq5J36L4svXS3p8DPNM6R7G0eIPSOAbssNAdU6D_9PxZUFZo Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Id: None Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Domain-Name: None Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Project-Name: admin Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Role: admin,member,reader Jun 24 23:42:25.664968 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Roles: admin,member,reader Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1b6f1fb3ca4d42909a61ac0a3da08290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1b6f1fb3ca4d42909a61ac0a3da08290"}]}] Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant: admin Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 1b6f1fb3ca4d42909a61ac0a3da08290 Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User: admin Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Id: 19e6b8d9d8f94b0c8f316b8b2060e76d Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: X-User-Name: admin Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: method: > Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: exception: Flavor 451 could not be found. Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: action_args: {'id': '451'} Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:42:25.666436 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:25.667478 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Jun 24 23:42:25.668836 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fb1dfc1f-c70b-4846-88af-64aa6376e4e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:42:25.670124 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-fb1dfc1f-c70b-4846-88af-64aa6376e4e8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012464 Jun 24 23:42:25.670124 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:42:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 23:42:26.503384 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:26.504381 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 24 23:42:26.504798 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:26.696347 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fd46b815-7ffc-44c4-8f9e-a32d4b7843ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:42:26.714484 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-fd46b815-7ffc-44c4-8f9e-a32d4b7843ba admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071115 Jun 24 23:42:26.714962 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jun 24 23:42:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:42:27.546842 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:27.547928 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 24 23:42:27.548317 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:27.746066 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-7ef39f82-163b-4eb6-9c57-86430751860f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:42:27.763340 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-7ef39f82-163b-4eb6-9c57-86430751860f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077264 Jun 24 23:42:27.763852 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jun 24 23:42:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:42:28.612093 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:28.613134 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 24 23:42:28.613534 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:28.809057 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-499ee9bc-1915-4d28-a226-80c04cb0745f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:42:28.828256 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-499ee9bc-1915-4d28-a226-80c04cb0745f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072737 Jun 24 23:42:28.829397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jun 24 23:42:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:42:29.677993 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:29.679003 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 24 23:42:29.679408 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:29.869359 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0986bbed-d121-441e-a049-73926c99e03c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:42:29.887958 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0986bbed-d121-441e-a049-73926c99e03c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069509 Jun 24 23:42:29.888481 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jun 24 23:42:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:42:30.708472 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:30.709499 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 24 23:42:30.709896 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:42:30.898619 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1e18088f-99e8-4791-a260-171b981e54be admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:42:30.917636 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-1e18088f-99e8-4791-a260-171b981e54be admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070752 Jun 24 23:42:30.918102 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Fri Jun 24 23:42:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:43:17.940278 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:17.941346 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d933cde3-e672-48d2-ba6d-e796f1d160c6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 24 23:43:17.941746 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jun 24 23:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:43:17.951944 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:43:18.001026 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1fce8431-fb23-4aa4-8878-b082c48f3c73 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:18.020810 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-1fce8431-fb23-4aa4-8878-b082c48f3c73 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073217 Jun 24 23:43:18.021347 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jun 24 23:43:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:43:18.043613 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-1bc36b10-9a42-4615-93db-d5896ead27a3 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:18.047080 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=14 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:43:18.052656 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-1bc36b10-9a42-4615-93db-d5896ead27a3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012585 Jun 24 23:43:18.053177 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Jun 24 23:43:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:43:18.064851 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2c010be2-c31e-4c6a-bc49-bc483e610b32 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:18.072423 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2c010be2-c31e-4c6a-bc49-bc483e610b32 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011683 Jun 24 23:43:18.072978 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Jun 24 23:43:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:43:18.084754 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:18.092229 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010946 Jun 24 23:43:18.092781 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Jun 24 23:43:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:43:18.103718 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fdf15a8b-5023-4d24-a722-302c9e147c76 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:43:18.111530 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-fdf15a8b-5023-4d24-a722-302c9e147c76 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011201 Jun 24 23:43:18.112044 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Jun 24 23:43:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:46:30.453464 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:30.454478 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 24 23:46:30.454894 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:46:30.609271 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=6 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:46:30.737624 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:30.739675 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:46:30.739675 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:46:30.741451 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:30.742057 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:30.742859 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:30.743291 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:30.783515 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ee1815e6-2698-4abf-84ee-a8a3db891bba admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175992 Jun 24 23:46:30.784465 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:46:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:46:31.628322 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:31.629357 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 24 23:46:31.629748 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:46:31.820397 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:31.821586 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:46:31.821586 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:46:31.822766 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:31.823201 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:31.823991 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:31.824440 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:31.844311 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-f104f908-49ce-44ae-9cfc-1945276d0157 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076707 Jun 24 23:46:31.844886 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:46:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:46:43.101215 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:43.102304 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 24 23:46:43.102705 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:46:43.246749 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:46:43.248047 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell1:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:46:43.248710 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=8 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:46:43.297240 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:43.298402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:46:43.298402 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:46:43.299572 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:43.300002 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:43.300806 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:43.301257 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:43.326009 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-425e98d2-4b7e-4ca8-8fc8-da42ab6d807c admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083771 Jun 24 23:46:43.326553 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:46:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:46:44.180426 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:44.181455 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c562eb44-d8fa-44d4-b9e8-127c09eba27f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 24 23:46:44.181849 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jun 24 23:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:46:44.384960 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:46:44.386112 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 23:46:44.386112 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: warnings.warn(msg) Jun 24 23:46:44.387273 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:44.387722 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:44.388494 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:46:44.389007 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:46:44.411307 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-6f118918-1957-437e-ba32-d734286e881f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078432 Jun 24 23:46:44.411840 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jun 24 23:46:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:47:41.869446 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: Fri Jun 24 23:47:41 2022 - graceful shutdown triggered... Jun 24 23:47:41.869584 dv-cinder-847624-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 23:47:41.870517 dv-cinder-847624-1-iscsi devstack@n-api.service[109606]: Gracefully killing worker 1 (pid: 109606)... Jun 24 23:47:41.870938 dv-cinder-847624-1-iscsi devstack@n-api.service[109607]: Gracefully killing worker 2 (pid: 109607)... Jun 24 23:47:42.871614 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: worker 1 buried after 1 seconds Jun 24 23:47:42.872021 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: worker 2 buried after 1 seconds Jun 24 23:47:42.872021 dv-cinder-847624-1-iscsi devstack@n-api.service[109605]: goodbye to uWSGI. Jun 24 23:47:42.873240 dv-cinder-847624-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 23:47:42.873891 dv-cinder-847624-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 23:47:42.876767 dv-cinder-847624-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 23:47:42.886024 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 23:47:42 2022] *** Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: nodename: dv-cinder-847624-1-iscsi Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: machine: x86_64 Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: clock source: unix Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: pcre jit disabled Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: detected number of CPU cores: 4 Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: current working directory: / Jun 24 23:47:42.888023 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: detected binary path: /usr/bin/uwsgi-core Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: your processes number limit is 47680 Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: your memory page size is 4096 bytes Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: detected max file descriptor number: 2048 Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: lock engine: pthread robust mutexes Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: thunder lock: enabled Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 23:47:42.888818 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 23:47:42.935174 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: Python main interpreter initialized at 0x559d3cc9b9c0 Jun 24 23:47:42.935174 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: python threads support enabled Jun 24 23:47:42.935174 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: your server socket listen backlog is limited to 100 connections Jun 24 23:47:42.935174 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: your mercy for graceful operations on workers is 90 seconds Jun 24 23:47:42.935622 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 23:47:42.935622 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: *** Operational MODE: preforking *** Jun 24 23:47:42.935911 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: *** uWSGI is running in multiple interpreter mode *** Jun 24 23:47:42.935911 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: spawned uWSGI master process (pid: 124074) Jun 24 23:47:42.938087 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: spawned uWSGI worker 1 (pid: 124092, cores: 1) Jun 24 23:47:42.938087 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: spawned uWSGI worker 2 (pid: 124093, cores: 1) Jun 24 23:47:42.938087 dv-cinder-847624-1-iscsi devstack@n-api.service[124074]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 23:47:42.936198 dv-cinder-847624-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 23:47:43.604628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 23:47:43.619123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 23:47:44.820616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:47:44.820616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: from cryptography.utils import int_from_bytes Jun 24 23:47:44.821206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:47:44.821206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: from cryptography.utils import int_from_bytes Jun 24 23:47:44.868659 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:47:44.868659 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: from cryptography.utils import int_from_bytes Jun 24 23:47:44.869242 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 23:47:44.869242 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: from cryptography.utils import int_from_bytes Jun 24 23:47:47.223983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 23:47:47.224537 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 23:47:47.224878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 23:47:47.225066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 23:47:47.225327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 23:47:47.225743 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.226060 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.226388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.226711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.227045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.227357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.227680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.228001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.228331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.228630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.228932 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.229257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847624-1-iscsi {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.229579 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.229889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.230203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.230530 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.230841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.231167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.231474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.231978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.234175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.234175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.234175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.234601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.234833 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.235142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.235469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.235785 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.236118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.236426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.236869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847624-1-iscsi {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.237211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.237519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.237822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.238252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.238578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.238897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.239216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.239521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.239835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.240164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.240478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.240834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.241189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.241467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.241774 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.242087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.242408 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.242712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.243017 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.243267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.243575 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.243895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.244214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.244536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.244819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.245071 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.245390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.245711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.246020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.246339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.246651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.246960 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.247272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.247577 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.247884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.248191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.249090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.249539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.249871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.250184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.250507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.250929 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.251181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.251500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.251842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.252162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.252476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.252822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.253147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.253460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.253771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.254082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.254405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.254746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.255055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.255307 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.255613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.255921 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.256241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.256555 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.256907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.257200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.257506 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.257813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.258123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.258430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.258738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.259048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.259355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.259662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.259968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.260277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.260635 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.261015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.261255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.261641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.261867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.262192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.262674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.262995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.263308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.263639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.264659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.265459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.265662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.265995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.266310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.266640 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.266957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.267260 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.267584 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.267897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.268206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.268514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.268852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.269162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.269477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.269778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.270086 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.270388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.270718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.271062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.271365 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.271689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.271985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.272306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.272938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.273277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.273619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.273935 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.274270 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.274601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.275429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.275429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.275758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.275903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.276189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.276448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.276788 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.277217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.277600 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.277770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.278054 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.278371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.278697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.279013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.279335 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.279708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.280149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.280463 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.280842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.281226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.281516 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.281830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.282161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.282475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.282789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.283098 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.283451 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.283752 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.284066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.284387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.284726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.285042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.285354 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.285666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.285979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.286378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.286634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.286954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.287266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.287763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.287933 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.288209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.288503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.288839 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.289148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.289453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.289763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.290069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.290394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.290740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.291044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.291384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.291689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.292179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.292672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.293145 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.293461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.293784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.294099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.294413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.294743 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.295059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.295403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.295874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.296446 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.296778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.297103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.297417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.297736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.298055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.298366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.298692 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.299009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.299325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.299664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.299997 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.300304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.300651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.300985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.301305 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.301612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.301922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.302234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.302540 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.302846 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.303153 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.303457 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.303761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.303974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 23:47:47.304465 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.304658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 23:47:47.304800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.304800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.305107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 23:47:47.305247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.305404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 23:47:47.305561 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.305710 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 23:47:47.305860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.306012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.306151 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.306313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.306466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.306617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.306775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.306916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.307055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.307198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.307435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.307577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.307735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.307895 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.308039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.308177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.308328 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.308557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.308729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.308872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.309020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.309168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.309331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.309551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847624-1-iscsi {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.309694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.309834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.309983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.310129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.310268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.310426 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.310573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.310715 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.311349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.311503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.311597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.311774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.311857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.311940 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.312018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.312400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.312571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.312810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.312931 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.313054 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.313155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.313375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.313498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.313716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.313843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.314052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.314136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.315892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.315991 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847624-1-iscsi {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.316193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.316284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.316505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.316626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.316859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.316960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.317172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.317337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.317490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.317656 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.317805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.319288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.319424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.319518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.319611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.319696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.319786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.319877 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.319972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.320064 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.320155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.320246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.320330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.320413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.320509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.320620 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.321549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.321645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.321645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.321791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.321865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.321942 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.322013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.322091 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.322184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.322280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.322365 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.322472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.322641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.322738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.322831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.322927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.323024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.323108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.323202 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.323294 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.323426 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.323589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.323694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.323864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.323976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.324170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.324280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.324488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.324677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.324823 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.324917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.325130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.325240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.325433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.325527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.325747 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.325839 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.326056 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.326148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.326369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.326540 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.326855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.326966 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.327134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.327227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.327456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.327558 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.327776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.327876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.328102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.328211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.329706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.330343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.330435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.330540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.330635 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.330728 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.330813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.330903 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.330998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.331168 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.331334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.331509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331594 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.331688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.331866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.331949 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.332048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.332134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.332225 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.332310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.332400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.332492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.332679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.332770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.332866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.332959 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.333052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.333146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.333366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.333481 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.333689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.333784 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.333986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.334100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.334241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.334334 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.334555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.334664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.334868 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.334969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.335181 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.335282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.335566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.335746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.335843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.335935 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.336081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.336174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.336407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.336503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.336842 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.337053 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.337149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.337337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.337431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.337648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.337754 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.337958 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.338049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.338267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.338360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.338591 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.338696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.338916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.339028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.339228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.339321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.339542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.339641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.339853 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.339956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.340166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.340259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.340498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.340718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.340829 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.340983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.341143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.341301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.341453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.341630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.341762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.341946 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.342583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.342887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.342979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.343200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.343311 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.343501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.343607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.343808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.343908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.344114 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.344228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.344426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.344520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.344769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.344862 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.345081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.345181 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.345388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.345481 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.345697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.345787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.346005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.346096 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.346311 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.346412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.346617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.346717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.346920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.347020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.347225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.347322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.347532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.347625 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.347838 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.347947 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.348161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.348263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.348485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.348576 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.348831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.348936 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.349135 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.349227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.349442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.349534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.349750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.349854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 23:47:47.350056 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.350978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.351077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.354524 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.354657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.354778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.354886 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.354981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355256 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355447 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355885 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.355975 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.356509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359276 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359575 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359656 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359865 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.359950 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360463 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.360982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361168 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361242 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.361970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362131 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362208 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362553 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.362721 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363614 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.363964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364116 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.364923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365469 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365635 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.365719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.366754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367680 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.367968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368120 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368640 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.368889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369003 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369539 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369670 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.369925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.370110 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.370264 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.370385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.370505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.371441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.371593 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.371737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.371857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.371975 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372105 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.372996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.373942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374728 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.374869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.375841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.376074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.376219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.376390 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.376552 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.377959 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.378964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379585 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.379877 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380082 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.380900 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381346 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.381982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.382943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383088 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383544 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.383933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384364 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384504 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384857 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.384998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385661 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.385924 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.386884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.387828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388048 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388365 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.388827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.389679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.389782 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390771 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.390998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391090 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.391956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392376 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.392929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393242 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393863 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.393956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394504 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394604 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.394905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.395907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396229 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396759 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.396866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.397095 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.397188 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.397402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.397505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.397980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398599 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.398921 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399633 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.399957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.400908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401118 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401232 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.401822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.402980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403701 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.403908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404690 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.404917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405548 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.405865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.406796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407452 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.407991 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408430 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.408964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409065 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409673 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.409953 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410620 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.410935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411278 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.411894 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412223 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.412984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413135 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413395 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.413859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.414119 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.414230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.414427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.414737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.414845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415383 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415714 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.415852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416176 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416700 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.416817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.417975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418395 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418703 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.418919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419053 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419230 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419354 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419544 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.419948 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.420771 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421406 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421547 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.421822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.422027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.422139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.422345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.422454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.422655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423414 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.423990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.424198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.424350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.424514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.424690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.424875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.425996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426612 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.426919 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427119 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427220 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427759 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.427851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.428826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429439 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429747 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.429972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430073 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.430901 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431218 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.431940 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432471 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.432914 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433131 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433650 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.433969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434636 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.434962 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435579 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435769 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.435941 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.436902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.437912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438201 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438352 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438494 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438816 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.438996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439140 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439448 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439833 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.439984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440558 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440690 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.440948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.441165 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.441256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442335 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442434 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.442968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443594 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.443994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.444948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445168 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445269 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.445966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446760 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.446866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447443 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.447952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448062 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448571 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448710 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.448998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449201 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449296 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449638 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.449909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450764 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.450861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.451109 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.451207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452868 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.452959 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.453185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.453291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.453498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.453588 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.453986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.454973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455312 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.455968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456131 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456432 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456761 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.456922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457048 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457231 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457538 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.457850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.458890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.459834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460646 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460811 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.460960 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461270 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461582 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.461957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462842 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.462980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463126 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.463840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464482 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464670 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464780 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.464983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465309 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.465922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.466985 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.467138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.467402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.467564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.467818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.467909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468801 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.468922 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.469854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.470835 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471490 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471749 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.471974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.472931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473518 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.473826 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474496 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.474988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475593 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.475895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476489 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.476920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477529 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.477828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478345 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478746 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.478970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479408 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479614 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479707 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.479937 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480037 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480342 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480558 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.480996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.481935 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.482143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.482235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.482479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.482594 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.483299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.483400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.483629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.483869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.483962 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.484195 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.484296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.484513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.484649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.484854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485169 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485684 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.485830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486347 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486468 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.486973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.487917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488379 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488546 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.488883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489661 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.489977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490295 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.490950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491398 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.491900 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492045 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492568 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492684 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.492925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493251 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493356 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493566 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493659 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493880 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.493973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.494187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.494290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.494428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 23:47:47.494574 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.494904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.495227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.495557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.495881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.496206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.496530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.496872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.497216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.497522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.497846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.498466 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.498807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.499131 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.499455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.499778 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.500100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.500426 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.500773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.501094 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.501411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.501732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.502068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.502397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.502730 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.503075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.503400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.503724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.504048 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.504371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.504758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.505083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.505403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.505723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.506044 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.506366 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.506685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.507004 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.507326 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.507646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.507962 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.508275 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.508613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.509012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.509258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.509596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.509924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.510243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.510564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.510886 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.511412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.511732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.512071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.512399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.512770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.513090 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.513415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.513754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.514595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.514908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.515224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.515540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.515854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.516182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.516500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.516840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.517168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.517482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.518024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.518380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.518706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.519039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.519371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.519694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.520011 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.520339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.520676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.520995 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.521321 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.521639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.521952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.522264 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.522585 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.523164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.523477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.523795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.524106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.524440 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.524782 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.525096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.525406 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.525726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.526042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.526351 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.526661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.526971 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.527289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.527598 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.527914 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.528225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.528540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.528876 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.529193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.529603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.530438 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.530920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.531235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.531560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.531878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.532206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.532526 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.532870 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.533222 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.533543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.534086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.534428 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.534757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.535098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.535438 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.535752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.536072 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.536382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.536737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.537059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.537378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.537695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.538013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.538330 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.538646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.538963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.539279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.539596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.539909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.540223 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.540540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.540891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.541213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.541558 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.541885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.542211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.542536 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.542863 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.543180 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.543497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.543813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.544129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.544453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.544814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.545163 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.545692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.546203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.546527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.546854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.547182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.547501 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.547830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.548158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.548477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.548831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.549150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.549485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.549834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.550171 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.550503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.550816 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.551128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.551437 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.551753 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.552079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.552399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.552736 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.553049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.553387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.553672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.553983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.554293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.554602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.554917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.555226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.555535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.555843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.556156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.556462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.556800 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.557117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.557427 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.557737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.558048 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.558237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO dbcounter [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Registered counter for database nova_api Jun 24 23:47:47.558358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.558666 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.559000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.559339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.559661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.559989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.560305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.560661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.561025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.561354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.561684 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.562007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.562323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.562660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.562977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.563295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.563613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.563929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.564245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.564561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.564915 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.565249 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.565564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.565895 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.566223 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.566551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.566872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.567187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.567522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.567839 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.568154 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.568475 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.568817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.569138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.569460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.569781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.570111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.570442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.570758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.571088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.571418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.571769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.572087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.572435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.572793 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.573115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.573779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.573779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 23:47:47.573970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 23:47:47.579311 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.586048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writer thread running {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.637064 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO dbcounter [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Registered counter for database nova_api Jun 24 23:47:47.644072 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.context [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5615ae4e-5e2b-4e7f-89df-a16968d1ea83(cell1) {{(pid=124092) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 23:47:47.648473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:47:47.650147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:47:47.650952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:47:47.652945 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:47:47.656097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO dbcounter [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Registered counter for database nova_cell0 Jun 24 23:47:47.658244 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_db.sqlalchemy.engines [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.660270 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO dbcounter [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Registered counter for database nova_cell1 Jun 24 23:47:47.664759 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writer thread running {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.667577 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.669744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.675787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writer thread running {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.677880 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writer thread running {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.723672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.context [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5615ae4e-5e2b-4e7f-89df-a16968d1ea83(cell1) {{(pid=124093) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 23:47:47.727874 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:47:47.729475 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:47:47.730295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:47:47.732263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:47:47.734310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO dbcounter [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Registered counter for database nova_cell0 Jun 24 23:47:47.738331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO dbcounter [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Registered counter for database nova_cell1 Jun 24 23:47:47.745608 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_db.sqlalchemy.engines [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.747352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_db.sqlalchemy.engines [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.753322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writer thread running {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.832463 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO dbcounter [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Registered counter for database nova_cell0 Jun 24 23:47:47.839237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.844258 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writer thread running {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.895100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writer thread running {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:47.905576 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO dbcounter [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Registered counter for database nova_cell0 Jun 24 23:47:47.912467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_db.sqlalchemy.engines [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 23:47:47.917100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writer thread running {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 23:47:48.184338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: WARNING keystonemiddleware.auth_token [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:47:48.192985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: WARNING keystonemiddleware.auth_token [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:47:48.254284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: WARNING keystonemiddleware.auth_token [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:47:48.261717 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: WARNING keystonemiddleware.auth_token [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:47:48.554956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: WARNING keystonemiddleware.auth_token [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:47:48.562136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: WARNING keystonemiddleware.auth_token [None req-8fbb8f36-792b-4663-baf1-c6db6b8ab04c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:47:48.567459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d3cc9b9c0 pid: 124092 (default app) Jun 24 23:47:48.608492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: WARNING keystonemiddleware.auth_token [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 23:47:48.614526 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: WARNING keystonemiddleware.auth_token [None req-fc690f00-fcd3-47b5-900b-7c624be6af5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 23:47:48.619866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d3cc9b9c0 pid: 124093 (default app) Jun 24 23:48:29.982930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:29.983860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:29.984690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:29.985621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:31.198144 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3bb08de7-72ae-42f6-9217-c2365d76cd8b tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Action: 'create', calling method: .version_select at 0x7f7a57b11700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1343639105", "metadata": {"Type": "work"}}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:32.660594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3bb08de7-72ae-42f6-9217-c2365d76cd8b tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.692506 Jun 24 23:48:32.661536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Jun 24 23:48:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2696 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 23:48:32.675177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-47fe2abc-6433-4f2b-90e4-dfe5c9878c46 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a579d7550>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:32.772758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-47fe2abc-6433-4f2b-90e4-dfe5c9878c46 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 200 len: 353 microversion: 2.1 time: 0.101886 Jun 24 23:48:32.773756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 2/2] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:32 2022] GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:32.903866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3a87bcf1-d71f-45bd-afc6-96a221b1d69c tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a57bc1280>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:32.946207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:32.948213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:32.952297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:32.953266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:48:33.565432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3a87bcf1-d71f-45bd-afc6-96a221b1d69c tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ddce52e6-da41-4057-970e-f1c3b6b33b38" status: 200 len: 350 microversion: 2.1 time: 1.031867 Jun 24 23:48:33.566207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 1/3] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:32 2022] GET /compute/v2.1/os-volumes/ddce52e6-da41-4057-970e-f1c3b6b33b38 => generated 350 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:33.787005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c2dea03b-101e-4d1d-ad4a-747b97491089 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a579d78b0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:33.992474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c2dea03b-101e-4d1d-ad4a-747b97491089 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 200 len: 354 microversion: 2.1 time: 0.209081 Jun 24 23:48:33.999577 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:33 2022] GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:34.006006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c383f4c8-4c79-4abf-b916-137b1579e683 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a57a17550>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:34.123899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c383f4c8-4c79-4abf-b916-137b1579e683 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 200 len: 354 microversion: 2.1 time: 0.122206 Jun 24 23:48:34.137403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 2/5] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:34 2022] GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:34.146367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-effcc128-388a-4e90-9063-dc80ceaf0009 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a579d7ca0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:34.477004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-effcc128-388a-4e90-9063-dc80ceaf0009 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 202 len: 0 microversion: 2.1 time: 0.334418 Jun 24 23:48:34.478470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 4/6] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:48:34 2022] DELETE /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:48:34.487661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e4a663a0-9d3e-4aaa-a929-899c417db531 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a57a174c0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:34.594964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e4a663a0-9d3e-4aaa-a929-899c417db531 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 200 len: 353 microversion: 2.1 time: 0.111414 Jun 24 23:48:34.595534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 3/7] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:34 2022] GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:48:35.342674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1ad1b260-1ab0-4bc9-b713-44e0846c3a45 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a5796f3a0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:35.609472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d83fe322-f4a3-4d83-9d27-fd9266064547 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Calling method '.version_select at 0x7f7a57a17dc0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:35.619821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1ad1b260-1ab0-4bc9-b713-44e0846c3a45 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c69ed335-00a2-4448-aa0c-08aa8eb549b7" status: 200 len: 350 microversion: 2.1 time: 0.281565 Jun 24 23:48:35.620390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:35 2022] GET /compute/v2.1/os-volumes/c69ed335-00a2-4448-aa0c-08aa8eb549b7 => generated 350 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:35.676306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-d83fe322-f4a3-4d83-9d27-fd9266064547 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] HTTP exception thrown: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d83fe322-f4a3-4d83-9d27-fd9266064547 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Request method failure captured: Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 HTTP/1.1 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1N5NQWpH5YnikWZiFhkH1oBYlr_Wf_u8uVqsrnyAFSW7iEsQuvRX41ztfs62HVlC_PRzkJXat2iIbLV4tTNO2IMpBN4vIUN5DD-yxyY9H9OJRWra9fZ0q1MT0qebXo6WlvpM2L1yJsKH4zM30Q__QCTNT1aRG9xMvQvuPc6diXyS8 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 33c3b742f5de48c9be3495113b017b2b Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-VolumesGetTestJSON-864726695 Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:48:35.683146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c3b742f5de48c9be3495113b017b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/33c3b742f5de48c9be3495113b017b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_33c3b742f5de48c9be3495113b017b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/33c3b742f5de48c9be3495113b017b2b"}]}] Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-VolumesGetTestJSON-864726695 Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 33c3b742f5de48c9be3495113b017b2b Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-VolumesGetTestJSON-864726695 Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-VolumesGetTestJSON-864726695-project Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: ef43a04070fa4955addbe514c661c974 Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-VolumesGetTestJSON-864726695-project Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'c1b5a120-cc47-40cc-9d6a-185033aaeb59'} Jun 24 23:48:35.685724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. (HTTP 404) (Request-ID: req-15c00e13-d140-48f8-abfb-9deeeeb07899) Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:48:35.686561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:48:35.688697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 23:48:35.691102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d83fe322-f4a3-4d83-9d27-fd9266064547 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] Returning 404 to user: Volume c1b5a120-cc47-40cc-9d6a-185033aaeb59 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d83fe322-f4a3-4d83-9d27-fd9266064547 tempest-VolumesGetTestJSON-864726695 tempest-VolumesGetTestJSON-864726695-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59" status: 404 len: 109 microversion: 2.1 time: 0.081839 Jun 24 23:48:35.693629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 4/9] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:35 2022] GET /compute/v2.1/os-volumes/c1b5a120-cc47-40cc-9d6a-185033aaeb59 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:48:37.420221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d1a2d36c-b507-43b0-900c-108f33aea843 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a579d7d30>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:37.509092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d1a2d36c-b507-43b0-900c-108f33aea843 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4c41ef59-4233-460f-8edc-5fa5c4002830" status: 200 len: 350 microversion: 2.1 time: 0.097826 Jun 24 23:48:37.524147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 6/10] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:48:37 2022] GET /compute/v2.1/os-volumes/4c41ef59-4233-460f-8edc-5fa5c4002830 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:37.539579 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e02b189c-8d96-4476-9c5b-759bbf3fee8f tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a579dfe50>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:37.757279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e02b189c-8d96-4476-9c5b-759bbf3fee8f tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.239036 Jun 24 23:48:37.758049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 5/11] 10.222.0.47 () {58 vars in 1133 bytes} [Fri Jun 24 23:48:37 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:37.772909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-90e206e4-ae39-4587-9eea-2f283aac56f7 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a579d7820>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:38.039708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-90e206e4-ae39-4587-9eea-2f283aac56f7 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.272542 Jun 24 23:48:38.040868 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 7/12] 10.222.0.47 () {58 vars in 1148 bytes} [Fri Jun 24 23:48:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:38.052401 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-90facd76-9ba3-45a4-83aa-54fdc74621cf tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a57943940>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:38.311032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-90facd76-9ba3-45a4-83aa-54fdc74621cf tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.262485 Jun 24 23:48:38.312408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1133 bytes} [Fri Jun 24 23:48:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:38.331595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7ade318b-1f00-40ca-9206-82b26a9a171d tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a5796fa60>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:38.500039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7ade318b-1f00-40ca-9206-82b26a9a171d tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.173745 Jun 24 23:48:38.512758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 8/14] 10.222.0.47 () {58 vars in 1166 bytes} [Fri Jun 24 23:48:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:38.513334 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3f5d5ceb-852b-4c2e-b361-780488f81873 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a579439d0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:38.793323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3f5d5ceb-852b-4c2e-b361-780488f81873 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.284528 Jun 24 23:48:38.794525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 7/15] 10.222.0.47 () {58 vars in 1169 bytes} [Fri Jun 24 23:48:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:38.806322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3ce22bb0-7b08-4c21-9dc5-897ddb01d9a6 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a5796fee0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:39.096060 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3ce22bb0-7b08-4c21-9dc5-897ddb01d9a6 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.293411 Jun 24 23:48:39.096631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1154 bytes} [Fri Jun 24 23:48:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:39.110655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-517a096f-eafb-40f8-af51-8c4b0c25af64 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a57952280>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:39.379165 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-517a096f-eafb-40f8-af51-8c4b0c25af64 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.275033 Jun 24 23:48:39.380028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 8/17] 10.222.0.47 () {58 vars in 1187 bytes} [Fri Jun 24 23:48:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:39.391367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1cd8de4c-c5b9-4302-a6ae-838416023579 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] Calling method '.version_select at 0x7f7a5796f3a0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:39.704707 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1cd8de4c-c5b9-4302-a6ae-838416023579 tempest-VolumesTestJSON-911058047 tempest-VolumesTestJSON-911058047-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.317263 Jun 24 23:48:39.705992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1154 bytes} [Fri Jun 24 23:48:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:45.165236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-492324907", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:45.323779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] validate_networks() for [('04d42125-bd03-4d11-9c66-f5357e9049c9', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:48:47.561073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c0083a28-e829-487e-ab08-6510eaff6e22 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: .version_select at 0x7f7a579d7ee0>, body: {"keypair": {"name": "tempest-keypair-795092375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuv0ddOD8Y9+Ld4xA8R/N0tEZmRMR59T805LhN8/EeE5OuXYeJc/TkzkYpMtjLrXwEVpU7EEzmSVRf3gu6qB+XdEGe8NNaPk7m/iZruYvmjnuB9lHbWntirVH2dq3iirw=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:47.697837 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-c0083a28-e829-487e-ab08-6510eaff6e22 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:47.708065 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-c0083a28-e829-487e-ab08-6510eaff6e22 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for user 2e78cf97bac4484f93c7359b86a26628 and project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:47.844404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c0083a28-e829-487e-ab08-6510eaff6e22 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.958827 Jun 24 23:48:47.850107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 11/19] 10.222.0.47 () {62 vars in 1199 bytes} [Fri Jun 24 23:48:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 966 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 24 23:48:48.872478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dea530b8-8d93-4af3-9f4f-4da15854f492 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: .version_select at 0x7f7a57948310>, body: {"keypair": {"name": "tempest-keypair-1536309712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYa/cnFRJAOywT7Uw2NwIrCmkYQn/PQergGnmRhISjBh4xvoVIRC982K7GnOrrcnvoUQoa5Y6ZyXAf84B/DthAR9/+Y9PXMTo3NI8yTrXW64ByP+NxqRa/IoY1JzE4R+w=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:48.912794 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-dea530b8-8d93-4af3-9f4f-4da15854f492 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for project a779b000010c4549989d8a8f25e8b1be. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:48.931188 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-dea530b8-8d93-4af3-9f4f-4da15854f492 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for user 927ffbcd7078473f97f42bdb54acf57e and project a779b000010c4549989d8a8f25e8b1be. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:49.033044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dea530b8-8d93-4af3-9f4f-4da15854f492 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.618946 Jun 24 23:48:49.033734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 12/20] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:48:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:50.571326 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:48:50.572361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:48:50.575541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:48:50.576665 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:48:50.579302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:48:50.697474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:50.699774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:50.705511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:50.706990 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:50.857114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:50.889027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for user 5eb7e8b4befd4d519b440c632b59e724 and project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:50.931362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:48:50.939919 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:48:51.186854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-18fd9da2-3c99-4a10-9782-49d1c0c8ffdc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.212594 Jun 24 23:48:51.187960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 9/21] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:48:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 6214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:48:51.204130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8cf1cb81-dd80-4092-b4eb-e35bbeb50105 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:51.204956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8cf1cb81-dd80-4092-b4eb-e35bbeb50105 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:51.628453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8cf1cb81-dd80-4092-b4eb-e35bbeb50105 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:51.658832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8cf1cb81-dd80-4092-b4eb-e35bbeb50105 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1221 microversion: 2.1 time: 0.464743 Jun 24 23:48:51.659426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 13/22] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:51 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1221 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:52.131824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1335491488", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:52.354331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] validate_networks() for [('04d42125-bd03-4d11-9c66-f5357e9049c9', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:48:54.985215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1137845883", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "networks": [{"uuid": "1073eacb-bb12-4909-8f0f-74f8c0028fab"}]}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:55.178418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:48:55.178418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:48:55.179381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:48:55.180001 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:48:55.180626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:48:55.202327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:55.203568 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:55.204692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:55.205307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:55.229543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] validate_networks() for [('1073eacb-bb12-4909-8f0f-74f8c0028fab', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:48:55.292224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:55.308994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for user 5eb7e8b4befd4d519b440c632b59e724 and project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:55.349918 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:48:55.357341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:48:55.563274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-60e9f865-0cd1-465f-abc7-0ed98dea3398 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.437925 Jun 24 23:48:55.569184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 10/23] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:48:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:48:55.592925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1659411321", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60e34007-a69c-47fc-8c00-8c9fc955fd1c"}], "security_groups": [{"name": "tempest-securitygroup--2061837048"}], "key_name": "tempest-keypair-795092375", "user_data": "}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:55.949606 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] validate_networks() for [('60e34007-a69c-47fc-8c00-8c9fc955fd1c', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:48:56.633885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:48:56.634540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:48:56.635175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:48:56.635828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:48:56.636383 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:48:56.649561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:56.650216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:56.651394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:56.652774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:56.675370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:56.681320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for user 2e78cf97bac4484f93c7359b86a26628 and project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:56.709549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:48:56.715243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:48:56.863013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:48:56.863529 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:48:56.864126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:48:56.864680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:48:56.865219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:48:56.866245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e38ac885-1fe7-47d4-9c3f-3c84c4c889a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.292936 Jun 24 23:48:56.868344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 11/24] 10.222.0.47 () {62 vars in 1187 bytes} [Fri Jun 24 23:48:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 23:48:56.884170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:56.887888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:56.889400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:56.893126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:56.955118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Getting quotas for project 4921002ea57c4f54a7a3b69d802a6430. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:56.973573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Getting quotas for user 151db87b1e7248d882108519fab1d938 and project 4921002ea57c4f54a7a3b69d802a6430. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:57.014657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:48:57.022861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:48:57.038774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-96238b89-1ee1-4449-ba95-16e59540f93e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: .version_select at 0x7f7a57057f70>, body: {"keypair": {"name": "tempest-keypair-261450619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQQ4VZXfHExEsdgJcBPEsVrFsRJyQvLHe6g/0f4SoUBxIB5yd2vj+6RM6KFtIhIfqSsTdQY/Ga7couYNEXU2oKmqLUrDckC6k+eZ8eCrjPWugJj7ai2t38Ps7MMQfmlWA=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:57.121413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-96238b89-1ee1-4449-ba95-16e59540f93e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:57.137098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-96238b89-1ee1-4449-ba95-16e59540f93e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:57.211598 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-168e2ab7-9bff-40d1-9a36-6026d021ad57 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.547207 Jun 24 23:48:57.212245 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 14/25] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:48:57.218269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:57.221841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:57.252547 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:57.258921 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:57.259766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:57.260216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:57.279051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-96238b89-1ee1-4449-ba95-16e59540f93e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.407217 Jun 24 23:48:57.285832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 12/26] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:48:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:48:57.294508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2080902524", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f87168d-b987-4697-a560-81cade710588"}], "security_groups": [{"name": "tempest-securitygroup--80582053"}], "key_name": "tempest-keypair-1536309712", "user_data": "}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:48:57.709728 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] validate_networks() for [('3f87168d-b987-4697-a560-81cade710588', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:48:57.807520 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:57.835641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-51e3f34f-d126-4e7a-b811-d42b44db9f14 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1226 microversion: 2.1 time: 0.621531 Jun 24 23:48:57.836256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:57 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1226 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:57.846979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:57.850160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:58.029580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:58.037665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:58.039234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:58.040334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5a0767a7-add9-4829-8178-09e30c58a6f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1281 microversion: 2.20 time: 0.203111 Jun 24 23:48:58.040936 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 16/28] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:48:57 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:48:58.066539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-295ece53-3f9e-4668-abf5-131bab5091a1 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:58.107254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-295ece53-3f9e-4668-abf5-131bab5091a1 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:58.254287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-295ece53-3f9e-4668-abf5-131bab5091a1 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:58.265991 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-295ece53-3f9e-4668-abf5-131bab5091a1 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1215 microversion: 2.1 time: 0.199755 Jun 24 23:48:58.266876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 17/29] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:58 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:58.857580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:58.858593 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:58.898950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:58.904263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:58.910965 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:58.913591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.117964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:59.130965 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-853c95ed-9112-44b3-b8f3-bc5ac5f1bace tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1218 microversion: 2.1 time: 0.278481 Jun 24 23:48:59.145669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 18/30] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:58 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:59.155448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:59.156265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:59.180766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.181658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.184079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.185655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.336114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:48:59.336636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:48:59.337055 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:48:59.337455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:48:59.338041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:48:59.368237 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.370469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:59.371891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.377270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.379543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.386115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:59.390625 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:59.395038 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aed96f69-7fc2-4cf1-86c5-9330ef566b81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1333 microversion: 2.20 time: 0.248264 Jun 24 23:48:59.400152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 19/31] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:48:59 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1333 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:48:59.415624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:59.421619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:48:59.450422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.454309 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.455808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:48:59.460896 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:48:59.471378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for project a779b000010c4549989d8a8f25e8b1be. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:48:59.566777 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for user 927ffbcd7078473f97f42bdb54acf57e and project a779b000010c4549989d8a8f25e8b1be. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:48:59.634685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:48:59.642807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:48:59.643952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aebc79c5-deae-499f-830f-ad7e8afdda27 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1267 microversion: 2.1 time: 0.242302 Jun 24 23:48:59.644503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 20/32] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:59 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:48:59.658546 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:48:59.899537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7acf5963-d8a0-4f8c-a211-602c8dc33272 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.612588 Jun 24 23:48:59.907198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 13/33] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:48:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:48:59.918768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6799bb7b-2dec-4261-b03d-c4f270aaef74 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:48:59.919546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6799bb7b-2dec-4261-b03d-c4f270aaef74 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:00.151993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:00.152996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:00.208225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:00.210981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:00.214891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:00.218781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:00.329725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6799bb7b-2dec-4261-b03d-c4f270aaef74 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:00.338599 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6799bb7b-2dec-4261-b03d-c4f270aaef74 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1238 microversion: 2.1 time: 0.431880 Jun 24 23:49:00.364954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 21/34] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:48:59 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1238 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:00.427362 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:00.434980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:00.455581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:00.456044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:00.474591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:00.475186 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:01.063787 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:01.104456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-645b7515-474d-40cd-9019-6e07fcb25255 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1282 microversion: 2.1 time: 0.958763 Jun 24 23:49:01.109723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 14/35] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:00 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1282 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:01.147761 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:01.150489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:01.182138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:01.186174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:01.191452 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:01.193066 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:01.563566 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:01.577638 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:01.592934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:01.594223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-38ba51d5-ed32-4c20-ba95-c717120293ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1351 microversion: 2.20 time: 1.176534 Jun 24 23:49:01.597334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 22/36] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:00 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1351 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:01.630549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:01.632479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:01.664459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:01.665549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:01.666559 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:01.667159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:02.175453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.184970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c35db355-347f-4de5-a36a-0e06816cc933 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1273 microversion: 2.1 time: 1.073072 Jun 24 23:49:02.186405 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 15/37] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:01 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1273 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:02.192639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:02.193510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:02.206593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:02.207618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:02.211647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:02.213063 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:02.389574 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.407983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-526d53df-aebb-478c-b340-082e37822bbf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1242 microversion: 2.1 time: 0.795662 Jun 24 23:49:02.410189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 23/38] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:01 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1242 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:02.460801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.473198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c682fc40-d05a-4d77-a7bd-a5f9511bd34e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1280 microversion: 2.1 time: 0.284766 Jun 24 23:49:02.473775 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 16/39] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:02 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:02.619873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:02.629419 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:02.641758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:02.654019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:02.655193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:02.655818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:02.834181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.843642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.845470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:02.846859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3a4e7923-5c95-4be1-8de7-53f17bad6de6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1339 microversion: 2.20 time: 0.231153 Jun 24 23:49:02.866854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 24/40] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:02 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:03.213556 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:03.214335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:03.222730 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.227954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:03.233452 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.235410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:03.431505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:03.432267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:03.453146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.454969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:03.457451 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.460316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:03.862029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:03.887580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7cfc4390-59f2-47b5-850b-47a9ae055cb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1308 microversion: 2.1 time: 0.460195 Jun 24 23:49:03.889679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 25/41] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:03 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:03.908891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:03.910471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:03.953871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.954469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:03.958665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:03.959412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:04.094442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:04.104033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-876204b5-ab42-4565-9e75-4661c0644687 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1273 microversion: 2.1 time: 0.899783 Jun 24 23:49:04.111046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 17/42] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:03 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1273 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:04.123845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:04.130823 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:04.166428 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:04.170178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:04.172221 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:04.178133 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:04.310160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:04.344065 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6b21d268-e577-4e02-abee-6d9a08a132f0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1280 microversion: 2.1 time: 0.442075 Jun 24 23:49:04.344065 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 26/43] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:03 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1280 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:04.349417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466046127", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b11b39b-22df-4ca5-82fe-6b58b236b565"}], "security_groups": [{"name": "tempest-securitygroup--713117175"}], "key_name": "tempest-keypair-261450619", "user_data": "}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:04.774544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] validate_networks() for [('3b11b39b-22df-4ca5-82fe-6b58b236b565', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:49:05.014757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:05.029954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:05.032211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:05.036335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6baa4568-8a68-4b1e-9740-aec777e855dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1339 microversion: 2.20 time: 0.923655 Jun 24 23:49:05.038601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 18/44] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:04 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1339 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:05.056731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:05.057706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:05.074926 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:05.076145 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:05.078340 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:05.079289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:05.870094 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:05.882044 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ad94939c-a61e-451c-a6c6-b69bbb0692f9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1296 microversion: 2.1 time: 0.841422 Jun 24 23:49:05.894433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 19/45] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:05 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1296 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:05.899622 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:05.900242 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:05.939836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:05.940545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:05.941591 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:05.942271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:06.442745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:06.451489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e9a7d05b-d325-4128-94b6-ca7cd1e2ee0f tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1273 microversion: 2.1 time: 0.555853 Jun 24 23:49:06.452070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 20/46] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:05 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1273 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:06.468528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:06.485986 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:06.502879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:06.502993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:06.503757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:06.504214 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:06.931079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:07.468337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:49:07.468957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:49:07.469534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:49:07.469845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:49:07.470261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:49:07.484628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:07.485094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:07.497029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:07.497390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:07.547597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:49:07.562795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:49:07.598788 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:49:07.601090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:49:07.727792 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b734a1fb-31ef-4d94-8a39-2405ae0423cc tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.388754 Jun 24 23:49:07.728433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 27/47] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:49:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:49:07.763741 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:07.764391 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:07.787908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:07.788529 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:07.789514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:07.790121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:08.202968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:08.229856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:08.242374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:08.247807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-43dc7fe4-208d-47a2-b884-9abb218cee67 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1339 microversion: 2.20 time: 0.500448 Jun 24 23:49:08.285419 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 28/48] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:07 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1339 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:08.293526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:08.301604 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:08.316062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:08.335252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:08.336108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:08.336556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:08.628360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:08.664182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1c3a039b-9463-43c6-b342-9f4b2eb1db5e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1296 microversion: 2.1 time: 0.376018 Jun 24 23:49:08.666276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 29/49] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:08 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1296 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:08.689581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:08.693808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:08.726691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:08.733878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:08.737162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:08.737730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.191226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.203457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b0265792-9669-4b10-9cc1-a96ce25be1d1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 2.747604 Jun 24 23:49:09.204086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 21/50] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:06 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 2751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:09.221938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:09.229519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:09.256977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.257649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.258788 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.259520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.432164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=8 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:09.469876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.489274 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cd13fe6f-8b7c-4207-8c21-c310382ab285 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1273 microversion: 2.1 time: 0.815467 Jun 24 23:49:09.503987 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 30/51] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:08 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1273 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:09.514454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:09.515990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:09.524366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:09.541574 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.546404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.547501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.548147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.587497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.597818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d9c090e1-a4ae-4a3c-8bb0-b85132934407 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1292 microversion: 2.1 time: 0.379881 Jun 24 23:49:09.608053 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 22/52] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:09 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1292 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:09.682268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:09.683338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:09.685410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=28 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:09.696946 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:09.708634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.717358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.718360 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:09.725725 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:09.854810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.879161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.882859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:09.891766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d8b6809a-7bd8-41bd-9d87-3e5145f12cf4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1339 microversion: 2.20 time: 0.381819 Jun 24 23:49:09.893053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 31/53] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:09 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:10.228209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:10.234708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:10.250199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:10.251494 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:10.255049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:10.255738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:11.396787 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:11.414617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7821f043-b974-4ad6-85d5-7f0ef9bb6936 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 1.733207 Jun 24 23:49:11.419596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 23/54] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:09 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:11.428769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:11.445696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:11.492341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:11.507284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:11.520435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:11.523911 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:12.103006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:12.114931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-648b0ab7-bd38-4310-9832-3ec97c8e6ae7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 1.897607 Jun 24 23:49:12.117972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 32/55] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:10 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:12.132348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:12.133281 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:12.155390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:12.156123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:12.160673 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:12.169499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:12.372505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:12.388249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8595fc5c-5e70-47c6-9405-d76a2016bf27 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1298 microversion: 2.1 time: 0.265388 Jun 24 23:49:12.390440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 33/56] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:12 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:12.399157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:12.399861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:12.421047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:12.425187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:12.426211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:12.428445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:12.808258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:12.825753 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5f058a2b-5a21-4eb6-aba0-27a33314860a tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 1.404837 Jun 24 23:49:12.826900 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 24/57] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:11 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:13.269175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-22c6f0d2-a759-4671-a63d-7f5623e94c77 req-e352a988-7b75-40cd-acb5-f7f11c374b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6babba1a-e4d5-4053-90c2-d201309bd0db", "tag": "96388227-d615-4437-9d96-2d65e2ebf656"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:13.296510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-22c6f0d2-a759-4671-a63d-7f5623e94c77 req-e352a988-7b75-40cd-acb5-f7f11c374b1f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:13.301499 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-22c6f0d2-a759-4671-a63d-7f5623e94c77 req-e352a988-7b75-40cd-acb5-f7f11c374b1f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:13.372525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-22c6f0d2-a759-4671-a63d-7f5623e94c77 req-e352a988-7b75-40cd-acb5-f7f11c374b1f service nova] Creating event network-changed:96388227-d615-4437-9d96-2d65e2ebf656 for instance 6babba1a-e4d5-4053-90c2-d201309bd0db on hv-cinder-84762 Jun 24 23:49:13.373232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-22c6f0d2-a759-4671-a63d-7f5623e94c77 req-e352a988-7b75-40cd-acb5-f7f11c374b1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124093) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 23:49:13.377106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:13.386794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:13.387884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:13.389170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:13.421989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.compute.rpcapi [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 23:49:13.429309 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] Releasing lock "compute-rpcapi-router" {{(pid=124093) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 23:49:13.475881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-57bad984-3520-4106-af43-4c6dc7ffaa8f None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.647284 Jun 24 23:49:13.476922 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 25/58] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:13.490838 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:13.491805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:13.507504 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:13.517134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:13.520921 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:13.521570 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:13.839805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:13.844341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:13.850681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:13.860784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:13.862249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b176e2de-3a69-4b3c-9483-75693abfa02f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 1.470167 Jun 24 23:49:13.866707 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 34/59] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:12 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:14.316467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-8767aaa0-8091-42df-8c4b-fa4903be2028 req-23d04aa1-6b4e-4811-94a5-75d0fbc8ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde", "tag": "61853c07-a05f-4c92-8f9a-24bb65456c57"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:14.336541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:14.348349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-8767aaa0-8091-42df-8c4b-fa4903be2028 req-23d04aa1-6b4e-4811-94a5-75d0fbc8ef73 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.350226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-dc570d20-805f-4ab2-b999-872f420d952c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.871897 Jun 24 23:49:14.351406 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-8767aaa0-8091-42df-8c4b-fa4903be2028 req-23d04aa1-6b4e-4811-94a5-75d0fbc8ef73 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.362347 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 26/60] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:13 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:14.378994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:14.381805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:14.395699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.398674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.399718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.403404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.424387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-8767aaa0-8091-42df-8c4b-fa4903be2028 req-23d04aa1-6b4e-4811-94a5-75d0fbc8ef73 service nova] Creating event network-changed:61853c07-a05f-4c92-8f9a-24bb65456c57 for instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde on hv-cinder-84762 Jun 24 23:49:14.426415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-8767aaa0-8091-42df-8c4b-fa4903be2028 req-23d04aa1-6b4e-4811-94a5-75d0fbc8ef73 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 23:49:14.431388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.436109 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.437249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.437910 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.455088 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.compute.rpcapi [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 23:49:14.456952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] Releasing lock "compute-rpcapi-router" {{(pid=124092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 23:49:14.491191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f47c63ca-ebce-4fac-99ba-13deadd84dcc None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.622915 Jun 24 23:49:14.491906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 35/61] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:14.498852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:14.499850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:14.507064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.507918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.508982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:14.510248 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:14.989675 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:15.001804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f70c456a-bc85-495b-bdee-a931ed2bb556 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.507657 Jun 24 23:49:15.006925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 36/62] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:14 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:15.041735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:15.043187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:15.051766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.052611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:15.054181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.054789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:15.140056 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:15.143457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=89 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:15.155385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f01b1393-afaa-44e3-ae45-d1ee96afe84f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.790536 Jun 24 23:49:15.158936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 27/63] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:14 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:15.209876 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:15.216007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:15.255051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.255506 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:15.265128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.270863 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:15.666672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:15.675230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-698d5bdc-bc1b-44ca-a2ce-6e42b3f11eb0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.666864 Jun 24 23:49:15.678939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 37/64] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:15 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:15.695290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:15.695986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:15.715607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.716102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:15.716929 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:15.717404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:16.213469 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.249485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.261511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.263301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f832cc34-02a1-41ce-aaad-dba2cfd15fbd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 1.096620 Jun 24 23:49:16.268016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 28/65] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:15 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:16.288378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:16.289181 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:16.313446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:16.313964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:16.316511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:16.319625 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:16.471160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.486521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7449a141-9b1e-4d34-a11b-7659332e7a80 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.803146 Jun 24 23:49:16.489551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 38/66] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:15 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:16.500733 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:16.501588 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:16.508700 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:16.509152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:16.510019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:16.510461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:16.931313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.945863 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-38086fcd-115c-4b43-88f9-9b8620f8bc3d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.676725 Jun 24 23:49:16.946765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 29/67] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:16 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:16.960321 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df28f5e-1882-43bb-85e4-895c077b884d", "tag": "99a72ef6-11cf-4c12-a6f0-c0c761487f2f"}, {"name": "network-changed", "server_uuid": "5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5", "tag": "a24eac32-170f-4a97-ad18-9d87820319c1"}, {"name": "network-changed", "server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:16.981655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:16.989867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2fb1ca55-d629-40cf-849a-8ccb813b77d4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.499163 Jun 24 23:49:16.992721 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 39/68] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:16 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:16.993185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:16.997491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.001427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:17.002021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:17.026194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.027104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.028054 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.028487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Creating event network-changed:99a72ef6-11cf-4c12-a6f0-c0c761487f2f for instance 6df28f5e-1882-43bb-85e4-895c077b884d on hv-cinder-84762 Jun 24 23:49:17.032890 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.035817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Creating event network-changed:a24eac32-170f-4a97-ad18-9d87820319c1 for instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 on hv-cinder-84762 Jun 24 23:49:17.036503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] Creating event network-changed:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:49:17.056637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-060e555b-fd3a-40b2-b4c9-5bcb9fba0530 req-3719b528-e781-45e1-8a04-d0b7ab1dc89c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.108546 Jun 24 23:49:17.060327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 30/69] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:17.287136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:17.287902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:17.306692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.307300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.310882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.311621 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.350359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:17.363334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-60e92442-0691-41a6-b460-83756294c0e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.368778 Jun 24 23:49:17.365386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 40/70] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:16 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:17.504041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:17.504680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:17.519075 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.525854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.529379 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:17.531064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:17.606528 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=28 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:18.039927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:18.050195 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2b24a07f-36d9-4ee7-a55c-45147fcfe8a0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.550745 Jun 24 23:49:18.051712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 41/71] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:17 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:18.080851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:18.084127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:18.101093 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.102131 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.103291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.104347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.718731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:18.734331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:18.740084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:18.742328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c2918574-0533-4414-99f9-5348967eb47d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 1.459355 Jun 24 23:49:18.746891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 31/72] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:17 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:18.753103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:18.754735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:18.778855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.785727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.788421 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.789701 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.824270 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:18.837226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-903844cc-b670-4670-ad22-fdb86d5bceac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.784208 Jun 24 23:49:18.843107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 42/73] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:18 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:18.849423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-e2773ce5-cc5e-4454-9c82-c0543959d364 req-ac728a49-6e50-41b9-a586-cafde42dbfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266fe95-e867-4be8-a5c5-8f60b19e1cb6", "tag": "24ec8691-f6ed-4396-85ee-c50a25b71b9a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:18.865368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-e2773ce5-cc5e-4454-9c82-c0543959d364 req-ac728a49-6e50-41b9-a586-cafde42dbfb2 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.866266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-e2773ce5-cc5e-4454-9c82-c0543959d364 req-ac728a49-6e50-41b9-a586-cafde42dbfb2 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.883762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-e2773ce5-cc5e-4454-9c82-c0543959d364 req-ac728a49-6e50-41b9-a586-cafde42dbfb2 service nova] Creating event network-changed:24ec8691-f6ed-4396-85ee-c50a25b71b9a for instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 on hv-cinder-84762 Jun 24 23:49:18.897770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-e2773ce5-cc5e-4454-9c82-c0543959d364 req-ac728a49-6e50-41b9-a586-cafde42dbfb2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051655 Jun 24 23:49:18.902340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 43/74] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:18.912329 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:18.913085 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:18.924079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.924720 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:18.925764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:18.926214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.343023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:19.346821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:19.356162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1d12c84b-f21f-492a-bb4a-442d9f859908 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.450500 Jun 24 23:49:19.357074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-654468cb-3391-4fa5-9842-da420c146f58 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.608574 Jun 24 23:49:19.357661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 32/75] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:18 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:19.366724 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 44/76] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:18 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:19.380919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:19.381643 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:19.404029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.404682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.405605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.406053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.602423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:19.612423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b9c47f63-4d3d-4017-a8b8-3b5fc3c45330 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.243616 Jun 24 23:49:19.613517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 45/77] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:19 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:19.779902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:19.781413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:19.792344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.800311 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.802368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.805197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.859474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:19.860080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:19.869518 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.870179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:19.871092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:19.871533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.034217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.050152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.056024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.061372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4c8c70ba-3abe-4a20-862e-cafd958feed7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.297260 Jun 24 23:49:20.071767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 33/78] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:19 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:20.116321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.124970 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-549c0f44-f2e7-4044-b653-c544fac41646 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.269134 Jun 24 23:49:20.125835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 46/79] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:19 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:20.297698 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-0ecf1dfa-c360-4e41-bfe0-499b38cc68d6 req-115e28f6-43be-42d5-8a9c-bb89f817b52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6babba1a-e4d5-4053-90c2-d201309bd0db", "name": "network-vif-plugged", "status": "completed", "tag": "96388227-d615-4437-9d96-2d65e2ebf656"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:20.305845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0ecf1dfa-c360-4e41-bfe0-499b38cc68d6 req-115e28f6-43be-42d5-8a9c-bb89f817b52b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.306281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0ecf1dfa-c360-4e41-bfe0-499b38cc68d6 req-115e28f6-43be-42d5-8a9c-bb89f817b52b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.317831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-0ecf1dfa-c360-4e41-bfe0-499b38cc68d6 req-115e28f6-43be-42d5-8a9c-bb89f817b52b service nova] Creating event network-vif-plugged:96388227-d615-4437-9d96-2d65e2ebf656 for instance 6babba1a-e4d5-4053-90c2-d201309bd0db on hv-cinder-84762 Jun 24 23:49:20.322709 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-0ecf1dfa-c360-4e41-bfe0-499b38cc68d6 req-115e28f6-43be-42d5-8a9c-bb89f817b52b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204056 Jun 24 23:49:20.324043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 34/80] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:20.376061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:20.381505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:20.384123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:20.385519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:20.394016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.394209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.394828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.395196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.396084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.396399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.396612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.397652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.571358 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.581138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c7ca13ac-ce91-43a7-a96c-37a12154ff12 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.208755 Jun 24 23:49:20.583120 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 47/81] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:20 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:20.631347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:20.632233 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:20.637314 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.641262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.641625 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.642400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:20.642830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:20.646978 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-aadc3744-e063-42db-880a-2953bd404840 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.267405 Jun 24 23:49:20.650469 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 35/82] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:20 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:20.811251 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:20.818736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0d66d691-fc8b-420b-a215-bd6693bc4a9d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.192341 Jun 24 23:49:20.819427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 48/83] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:20 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:21.079894 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:21.081028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:21.087767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.089599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.090488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.091019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.143064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:21.144464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:21.156275 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.156982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.157772 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.160244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.241646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.252561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.254428 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.255873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-19a595b9-f434-41fe-bc04-ece77ed7179e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.180043 Jun 24 23:49:21.266076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 36/84] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:21 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:21.372017 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.381035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4cdc8b3b-0493-40a5-8424-e5426427d013 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.242239 Jun 24 23:49:21.381901 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 49/85] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:21 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:21.598912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:21.599549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:21.606726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.607182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.607954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.608396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.667638 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:21.668261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:21.678216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.678667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.679445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.683049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.764254 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.772128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bfd2ee92-51f2-435d-ae96-27ceb2517a6e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.177025 Jun 24 23:49:21.777561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 37/86] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:21 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:21.846347 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:21.847860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:21.857151 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.857860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.859052 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:21.859754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:21.895358 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:21.906513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0003cfc4-49f7-4682-89dd-3bd0f252acc4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.243000 Jun 24 23:49:21.916386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 50/87] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:21 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:22.245514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:22.253024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d89fc5fb-747c-45ac-a8ec-78ff9464cd48 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.419235 Jun 24 23:49:22.253596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 38/88] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:21 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:22.275114 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:22.275920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:22.282752 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.283273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.284095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.284528 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.399857 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:22.400540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:22.416206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.420395 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.421619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.424706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.498738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:22.510699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:22.516220 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:22.518475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aa63879a-e338-4166-8a9d-da92f848fcc1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.248120 Jun 24 23:49:22.531317 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 51/89] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:22 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:22.641992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-aebb902c-b57f-4171-a861-d9b5d069d2d9 req-4992e704-5a07-4997-b60d-3a7ceadfab1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde", "name": "network-vif-plugged", "status": "completed", "tag": "61853c07-a05f-4c92-8f9a-24bb65456c57"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:22.651818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-aebb902c-b57f-4171-a861-d9b5d069d2d9 req-4992e704-5a07-4997-b60d-3a7ceadfab1a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.652333 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-aebb902c-b57f-4171-a861-d9b5d069d2d9 req-4992e704-5a07-4997-b60d-3a7ceadfab1a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.665332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-aebb902c-b57f-4171-a861-d9b5d069d2d9 req-4992e704-5a07-4997-b60d-3a7ceadfab1a service nova] Creating event network-vif-plugged:61853c07-a05f-4c92-8f9a-24bb65456c57 for instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde on hv-cinder-84762 Jun 24 23:49:22.669965 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:22.673104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-aebb902c-b57f-4171-a861-d9b5d069d2d9 req-4992e704-5a07-4997-b60d-3a7ceadfab1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035134 Jun 24 23:49:22.674202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 52/90] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:22.678739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a0ec09ea-6f2a-4cc6-9121-f784ba928203 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.283704 Jun 24 23:49:22.679304 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 39/91] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:22 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:22.795284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:22.797031 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:22.805196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.805627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.806512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.806967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.813971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:22.926931 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:22.927562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:22.935673 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.936132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.937023 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:22.937624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:22.999167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.008071 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4e8063d6-3d2b-49cd-87b4-625540f8299e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.217750 Jun 24 23:49:23.009924 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 53/92] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:22 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:23.136738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.144253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-db2415a6-850b-432f-b49e-a7be5a557763 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.224828 Jun 24 23:49:23.145164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 40/93] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:22 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:23.271068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:23.271681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:23.279717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.280813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.281725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.282300 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.422821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.430392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-674f54e5-a8c6-4efa-9529-81ec46407822 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.163532 Jun 24 23:49:23.430959 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 54/94] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:23 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:23.550316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:23.551606 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:23.553810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:23.562316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.562772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.563547 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.563992 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.696843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:23.697453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:23.705271 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.705985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.706916 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:23.707507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:23.795257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.806703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.809473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.810942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8a980f43-92c4-4ae0-8960-74c029db8fee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.264576 Jun 24 23:49:23.812011 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 41/95] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:23 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:23.957343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:23.969781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8cc7797d-3114-4a20-a3ef-b0ced76dba81 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.277399 Jun 24 23:49:23.971134 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 55/96] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:23 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:24.027851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:24.030194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:24.040482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.041804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.042988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.043660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.163007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:24.163916 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:24.171335 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.172273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.173206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.173989 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.208173 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.224574 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b1bbfc03-c5c7-4c8c-bf07-17d0df060c42 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.203507 Jun 24 23:49:24.225193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 42/97] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:24 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:24.365307 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.374825 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4169da58-9364-41a2-b188-6334f2396ae9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.216153 Jun 24 23:49:24.375718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 56/98] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:24 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:24.449703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:24.450331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:24.456521 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.457012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.457790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.458285 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.594873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.602214 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3cf1782f-0539-4cdc-8526-205612e6a3f1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.157119 Jun 24 23:49:24.602790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 43/99] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:24 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:24.828381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:24.829023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:24.830829 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:24.836343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.836858 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.837634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.838145 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.975502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.983850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.985386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:24.986491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8fa95518-46d2-48d1-ae7d-597c21ff785e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.161987 Jun 24 23:49:24.987359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 57/100] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:24 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:24.989104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:24.989724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:24.997461 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:24.998248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:24.999807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.000480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.146206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:25.154170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5b754b58-c2dd-4fa4-bb5d-c432830acfbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.169013 Jun 24 23:49:25.164099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 44/101] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:24 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:25.249165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:25.251983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:25.272946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.277664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.278849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.281371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.394159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:25.395933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:25.408643 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.409146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.410171 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.410831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.425522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:25.433818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b7749527-d355-4308-99e5-ea3e469ee80c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.193706 Jun 24 23:49:25.434602 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 58/102] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:25 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:25.575329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:25.577807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:25.585417 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5d477450-3b0f-42aa-9611-0990ef6dbd79 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.196888 Jun 24 23:49:25.586204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 45/103] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:25 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:25.619329 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:25.619981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:25.627980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.628430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.629244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:25.629761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:25.783250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:25.790944 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4905963c-3d1c-47da-a855-aef7f768c6e0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.175407 Jun 24 23:49:25.800492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 59/104] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:25 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:26.005863 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:26.006469 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:26.013107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.013556 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.014323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.014802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.158565 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.166571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.168067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.169374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ade8897f-0b02-4dcc-8352-ee9e5f6b2f1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.167484 Jun 24 23:49:26.169920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 46/105] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:26 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:26.180413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:26.181149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:26.205319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.205319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.206095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.206530 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.377849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.386582 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2f1d594e-3cd7-41bd-ae0b-ef887588c05e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.219066 Jun 24 23:49:26.387163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 60/106] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:26 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:26.452542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:26.453271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:26.461937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.462715 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.464598 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.465369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.538857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-9ab5d29d-67b5-4108-b2f7-55264bc806e9 req-0dceb306-d936-4b3a-8e89-00a5aadfa011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df28f5e-1882-43bb-85e4-895c077b884d", "name": "network-vif-plugged", "status": "completed", "tag": "99a72ef6-11cf-4c12-a6f0-c0c761487f2f"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:26.548291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-9ab5d29d-67b5-4108-b2f7-55264bc806e9 req-0dceb306-d936-4b3a-8e89-00a5aadfa011 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.548790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-9ab5d29d-67b5-4108-b2f7-55264bc806e9 req-0dceb306-d936-4b3a-8e89-00a5aadfa011 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.562428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-9ab5d29d-67b5-4108-b2f7-55264bc806e9 req-0dceb306-d936-4b3a-8e89-00a5aadfa011 service nova] Creating event network-vif-plugged:99a72ef6-11cf-4c12-a6f0-c0c761487f2f for instance 6df28f5e-1882-43bb-85e4-895c077b884d on hv-cinder-84762 Jun 24 23:49:26.567891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-9ab5d29d-67b5-4108-b2f7-55264bc806e9 req-0dceb306-d936-4b3a-8e89-00a5aadfa011 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 Jun 24 23:49:26.568783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 61/107] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:26.604480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:26.605223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:26.614029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.614589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.615590 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.616267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.650386 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.658983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ec0dbf42-1fbb-4787-9e68-eca4ba1a17b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.210853 Jun 24 23:49:26.659562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 47/108] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:26 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:26.757388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.765199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2595f965-c834-4fca-9dd7-8d178a72da4c tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.165545 Jun 24 23:49:26.765770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 62/109] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:26 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:26.808388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:26.809041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:26.815004 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.815454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.816215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:26.816679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:26.952319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:26.962824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a36fc11c-1540-41d0-a5c0-24beec2a5004 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.156964 Jun 24 23:49:26.964300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 48/110] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:26 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:27.188059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:27.188793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:27.194701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.195141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.195892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.196318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.330098 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.337895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.339511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.340629 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3a7a1eed-7825-4d8a-96a1-675a2f9a15e9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.156492 Jun 24 23:49:27.341181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 63/111] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:27 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:27.408768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:27.409381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:27.417580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.418292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.419212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.419755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.576359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.587302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bd544101-a26f-4d16-802e-4a635c34a0d9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.182369 Jun 24 23:49:27.592424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 49/112] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:27 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:27.675716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:27.676440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:27.684304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.685228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.686207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.686848 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.785890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:27.786494 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:27.800279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.800766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.801547 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.801981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.856311 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.865870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-48a8680e-f172-4f21-9c62-2813f029a6d3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.193624 Jun 24 23:49:27.866721 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 64/113] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:27 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:27.967712 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:27.982654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:27.983792 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:27.986663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1afbe00b-3ee6-472b-9468-b5100922a05e tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.204550 Jun 24 23:49:27.987305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 50/114] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:27 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:27.990765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.991226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:27.991967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:27.992401 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.130044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:28.137978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a3451577-8d58-4a08-b235-786b883ee03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.161305 Jun 24 23:49:28.138535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 65/115] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:27 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:28.358847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:28.359458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:28.365473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.365917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.366672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.367101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.502562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:28.511979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:28.513575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:28.514711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bfac9e61-55fd-4671-a721-34c2dd98fdfc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.159789 Jun 24 23:49:28.515272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 51/116] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:28 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:28.604898 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:28.605514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:28.611525 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.611907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.612685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.613124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.740990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:28.749170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-03d198d8-4922-4397-b3f2-6db993063c83 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.148652 Jun 24 23:49:28.749732 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 66/117] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:28 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:28.883752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:28.884289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:28.890776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.891236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:28.892001 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:28.892443 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.003470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:29.004258 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:29.010679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.011147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.011905 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.012332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.017485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.025280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0ce1e8b2-a7e0-4d4c-ad55-959695154212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.145489 Jun 24 23:49:29.025845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 52/118] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:28 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:29.153409 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.155266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:29.155877 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:29.161440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a49e75bc-2d8b-4622-b001-4e15d9767da5 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.162024 Jun 24 23:49:29.162014 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.162113 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 67/119] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:28 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:29.162477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.163351 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.163808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.297589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.304848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-37691d89-975a-4cef-b1a0-31179809eda4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.153921 Jun 24 23:49:29.305405 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 53/120] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:29 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:29.533306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:29.533913 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:29.539845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.540296 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.541085 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.541552 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.670894 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.678648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.680163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.681302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6403a1df-5d64-45c6-b177-cfb542278716 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.151912 Jun 24 23:49:29.681853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 68/121] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:29 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:29.766134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:29.766741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:29.772902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.773345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.774092 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:29.774517 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:29.900114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:29.907480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-128931f1-8ebb-4398-89e5-ed88c2a005f1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.145189 Jun 24 23:49:29.908040 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 54/122] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:29 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:30.042540 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:30.043181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:30.049167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.049612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.050371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.050800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.177291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:30.179043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:30.179651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:30.185523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2c4eccff-3ee7-45bf-b71e-94ba36e8db90 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.147065 Jun 24 23:49:30.186085 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 69/123] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:30 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:30.186491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.186938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.187731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.188157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.315610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:30.320782 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:30.321403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:30.323739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-07125306-61a4-4ef2-a9fe-9f9757cbc545 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.147748 Jun 24 23:49:30.324303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 55/124] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:30 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:30.327400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.327846 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.328634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.329069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.346761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:30.462876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:30.470429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7214bf5f-46b8-4ae8-b26b-96a2b913d6ba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.153452 Jun 24 23:49:30.470986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 70/125] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:30 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:30.701368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:30.702008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:30.717144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.718293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.719087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.721710 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.924273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:30.924850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:30.940401 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.940889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:30.941706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:30.942172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.246072 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.262084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-15167b89-0a11-422c-a062-5f2f406efb2f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.341611 Jun 24 23:49:31.262678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 71/126] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:30 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:31.275290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:31.276122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:31.288966 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.289441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.290247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.290697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.418679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.431555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.435619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.437767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0cbfc7df-5963-4a3d-a5c2-4d727f5ff67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.742371 Jun 24 23:49:31.449573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 56/127] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:30 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:31.456480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.457153 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-cb50bff4-5acc-4632-a9bb-62b999313d4d req-d005ab99-5c9f-4bf9-a2b2-e39fb53f2435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5", "name": "network-vif-plugged", "status": "completed", "tag": "a24eac32-170f-4a97-ad18-9d87820319c1"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:31.467917 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2385c5db-0d59-4b7e-b344-3fe54181a984 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.204174 Jun 24 23:49:31.470313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 72/128] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:31 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:31.478440 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-cb50bff4-5acc-4632-a9bb-62b999313d4d req-d005ab99-5c9f-4bf9-a2b2-e39fb53f2435 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.481196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-cb50bff4-5acc-4632-a9bb-62b999313d4d req-d005ab99-5c9f-4bf9-a2b2-e39fb53f2435 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.488903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:31.490331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:31.500376 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-cb50bff4-5acc-4632-a9bb-62b999313d4d req-d005ab99-5c9f-4bf9-a2b2-e39fb53f2435 service nova] Creating event network-vif-plugged:a24eac32-170f-4a97-ad18-9d87820319c1 for instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 on hv-cinder-84762 Jun 24 23:49:31.511185 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.511923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-cb50bff4-5acc-4632-a9bb-62b999313d4d req-d005ab99-5c9f-4bf9-a2b2-e39fb53f2435 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059648 Jun 24 23:49:31.512525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 57/129] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:31.518023 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:31.518378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.518712 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:31.519308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.519862 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.527339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.528124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.529432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:31.530811 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:31.727963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.741336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9592081b-baa0-43a0-a5cb-f52dc9025935 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.269619 Jun 24 23:49:31.741923 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 73/130] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:31 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:31.767618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:31.775610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c3c0869c-6955-4a9c-b5fd-38660474dbce tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.261914 Jun 24 23:49:31.776855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 58/131] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:31 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:32.279538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:32.280153 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:32.286469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.287013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.288097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.288539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.422009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.429369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0f105de4-b9f2-4a3d-a444-01bd06222f86 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.154119 Jun 24 23:49:32.429924 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 74/132] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:32 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:32.456277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:32.456924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:32.463632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.464071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.464849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.465275 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.485605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:32.486244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:32.492204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.492685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.493441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.493872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.594946 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.602813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.604841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.605943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3aaabdd4-fd47-4760-a4ae-5874e169ae6a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.153905 Jun 24 23:49:32.606497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 59/133] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:32 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:32.624198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.631512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b1c417e1-ad50-42c8-a7d9-ce97af2fc573 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.149664 Jun 24 23:49:32.632059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 75/134] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:32 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:32.757956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:32.758560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:32.764427 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.764909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.765657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.766081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.794046 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:32.794722 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:32.800886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.801337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.802108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:32.802543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:32.911113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.919411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0512f314-1819-45aa-8930-c3bc74d50bc6 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.165193 Jun 24 23:49:32.919977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 60/135] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:32 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:32.944004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:32.951799 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ecc89400-0ebe-4153-bf7e-d5f3f3bc4ec2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.162799 Jun 24 23:49:32.952347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 76/136] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:32 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:33.446892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:33.447409 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:33.454251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.454700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.455448 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.455875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.585845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:33.594281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ff21295e-0f69-4763-88e3-34de3046a1ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.151269 Jun 24 23:49:33.594860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 61/137] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:33 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:33.623304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:33.623903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:33.629806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.630244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.630993 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.631417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.648445 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:33.649091 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:33.655762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.656215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.657006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.657444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.758336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:33.766761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:33.769424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:33.770544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-58d22a70-4ea1-4367-972e-119cd5445be1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.151346 Jun 24 23:49:33.771283 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 77/138] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:33 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:33.788401 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:33.796193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ebb25d9f-0c9e-469d-95e4-e781209f67b4 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.151610 Jun 24 23:49:33.796502 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 62/139] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:33 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:33.935822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:33.936467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:33.942538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.942983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.943748 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.944182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.969539 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:33.970525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:33.977833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.978282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.979792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:33.980496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:33.983467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:34.076164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.083650 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5c6222d9-a4c9-490e-912b-4d74fafd621d tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.152246 Jun 24 23:49:34.084209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 78/140] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:33 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:34.114657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.122589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c1955ee0-63d7-496e-b43c-7ab2ed43f3b0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.157686 Jun 24 23:49:34.123150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 63/141] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:33 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:34.610970 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:34.611578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:34.617620 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.618065 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.618819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.619247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.746219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.753496 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-89acddc6-fc1f-4557-b191-95ee487cba20 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.146458 Jun 24 23:49:34.754053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 79/142] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:34 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:34.789497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:34.790146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:34.796651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.797102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.797872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.798307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.813680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:34.814282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:34.820526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.820995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.821745 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:34.822170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:34.928543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.937460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.938933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.945388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-58d968d9-387d-480d-b269-6d67116cbdb6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.154511 Jun 24 23:49:34.946411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 64/143] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:34 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:34.962021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:34.970473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-36dc4924-8c5a-4de0-a0fa-658cf4904a86 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.160815 Jun 24 23:49:34.971194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 80/144] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:34 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:35.100337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:35.101004 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:35.110651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.111191 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.111986 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.112423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.139491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:35.140103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:35.145330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:35.149079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.149526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.150308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.151307 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.255381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:35.264129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-11bb54db-68d7-4bdd-8ff7-6684220c9cfc tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.167501 Jun 24 23:49:35.265502 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 65/145] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:35 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:35.300866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:35.309476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-496f35ea-e82a-4330-ab23-dd8315ed5f82 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.174115 Jun 24 23:49:35.310507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 81/146] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:35 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:35.770005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:35.770607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:35.779619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.780069 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.780870 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.781307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.926214 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:35.934609 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-35f189a6-ea7c-478f-ac9e-0c5d5514f693 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.168377 Jun 24 23:49:35.935183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 66/147] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:35 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:35.963810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:35.964429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:35.970615 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.971061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.971817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.972245 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.988342 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:35.988987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:35.995063 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.995513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:35.996280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:35.996752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.106213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.115557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.117202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.118190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-541c5340-c9c8-47c4-a7e7-0726bb44ec5f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.158854 Jun 24 23:49:36.118951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 82/148] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:35 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:36.127428 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.135672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a4b550c2-cb82-468d-b50e-628b12097ef7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.150604 Jun 24 23:49:36.136990 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 67/149] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:35 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:36.283572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:36.284178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:36.290198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.290638 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.291464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.291918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.326373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:36.326989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:36.333340 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.333870 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.334708 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.335215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.420240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.427672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-64c7bc2b-d336-4bdc-96c8-40a8d8abf974 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.148267 Jun 24 23:49:36.428234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 83/150] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:36 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:36.468942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:36.476224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fb182cf9-67d8-4edc-b156-8334ab15d991 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.154396 Jun 24 23:49:36.476804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 68/151] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:36 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:36.952123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:36.952767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:36.959001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.959441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:36.960201 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:36.960651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.087397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.095334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0a7295e3-2ec5-47fa-b8a2-1e61c73129c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.148016 Jun 24 23:49:37.095886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 84/152] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:36 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:37.136706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:37.137238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:37.143173 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.143619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.144381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.144846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.153042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:37.153737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:37.159841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.160365 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.161219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.161718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.275361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.285497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.287006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.288114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-036b6c59-e151-4691-bae5-54c52c6bd5ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.156044 Jun 24 23:49:37.288687 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 69/153] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:37 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:37.295479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.302774 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-768c96bf-9156-4453-a5c0-055ec0012317 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.154523 Jun 24 23:49:37.303325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 85/154] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:37 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:37.444212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:37.444846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:37.451016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.451457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.452216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.452661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.496028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:37.496704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:37.503265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.503702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.504471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.504932 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.591337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.599785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b35b9846-dd49-4daa-9001-70ef4bef3fe9 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.159415 Jun 24 23:49:37.600473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 70/155] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:37 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:37.684359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:37.692792 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2a324046-1d6d-4a98-9543-19ca37825e43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.201126 Jun 24 23:49:37.702884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 86/156] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:37 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:37.915454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-524c68e8-745e-4c53-84df-684bed824176 req-00f55304-c9f7-46a9-929c-d26b6764f5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "name": "network-vif-plugged", "status": "completed", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:37.925008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-524c68e8-745e-4c53-84df-684bed824176 req-00f55304-c9f7-46a9-929c-d26b6764f5d5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:37.925008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-524c68e8-745e-4c53-84df-684bed824176 req-00f55304-c9f7-46a9-929c-d26b6764f5d5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:37.938509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-524c68e8-745e-4c53-84df-684bed824176 req-00f55304-c9f7-46a9-929c-d26b6764f5d5 service nova] Creating event network-vif-plugged:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:49:37.943593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-524c68e8-745e-4c53-84df-684bed824176 req-00f55304-c9f7-46a9-929c-d26b6764f5d5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Jun 24 23:49:37.944518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 71/157] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:38.111139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:38.111874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:38.117939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.118462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.119858 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.120302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.124268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:38.265157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.273509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3300c659-9cde-4d4e-b3c6-bc370f9b03c5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.166205 Jun 24 23:49:38.274805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 87/158] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:38 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:38.308706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:38.309513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:38.319114 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:38.320261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:38.331764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.332549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.333069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.333911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.334404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.335174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.335609 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.337148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.528338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.531414 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.548178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a1d2685e-1dd5-45a9-b627-c1fe20412c63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.232745 Jun 24 23:49:38.550137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.550874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 88/159] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:38 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:38.552514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.553764 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cb80ccb1-7372-4c76-b422-317a07aa150c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.250317 Jun 24 23:49:38.565653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 72/160] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:38 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:38.618373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:38.619055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:38.630957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.631417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.632348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.632816 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.715782 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:38.716574 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:38.722590 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:38.724364 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.725016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.726603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:38.727334 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:38.848113 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.856996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6bd9f6a7-cab0-43e4-9070-5f4e35c714fd tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.242931 Jun 24 23:49:38.857740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 89/161] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:38 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:38.897814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:38.906157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-dd1c273f-586f-464f-bd0e-37135b5c31f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.196660 Jun 24 23:49:38.906943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 73/162] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:38 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:39.291255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:39.292403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:39.298586 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.299292 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.300062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.300545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.446959 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:39.455931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-49a9ee6c-bddf-4a92-a0e2-25dc3992f2be tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.168738 Jun 24 23:49:39.456501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 90/163] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:39 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:39.567934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:39.568472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:39.573057 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:39.573721 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:39.575155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.575604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.576791 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.576791 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.580102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.580545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.581729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.582165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.732030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:39.734969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:39.742733 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:39.744995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:39.746182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3b727528-75e4-418b-b313-27402f63c181 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.178026 Jun 24 23:49:39.749415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 91/164] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:39 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:39.752642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3960df5e-c570-4d02-bc8b-30d3b3852978 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.188899 Jun 24 23:49:39.753203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 74/165] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:39 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:39.874256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:39.874891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:39.880899 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.881347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.882104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.882538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.924238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:39.924983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:39.931079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.931532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:39.933018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:39.933406 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.016925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.024532 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1cd7409d-eaf5-408e-a7ff-5eb90692c690 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.154083 Jun 24 23:49:40.025111 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 92/166] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:39 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:40.062383 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.069868 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5c3f058b-9211-420f-803d-42103754c0cc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.149456 Jun 24 23:49:40.070450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 75/167] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:39 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:40.472467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:40.473110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:40.480331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.480783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.481544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.481975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.606217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.613475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-da9af9ad-7969-470b-87ba-d80adcf23fee tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.144977 Jun 24 23:49:40.614062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 93/168] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:40 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:40.763491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:40.764070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:40.769660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:40.770155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.770275 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:40.770608 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.771372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.771810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.776995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.777446 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.778205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:40.778644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:40.920215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.927826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.929368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.930479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-645966b9-9dd3-4dbd-96fc-069ce8e76af4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.171168 Jun 24 23:49:40.931231 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:40.931379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 76/169] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:40 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:40.943851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9cf833c3-2321-49f5-b5dd-c007f8b12e63 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.177932 Jun 24 23:49:40.944401 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 94/170] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:40 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:41.041731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:41.042266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:41.048217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.048701 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.049457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.049891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.086855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:41.087482 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:41.094042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.094523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.095274 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.095697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.257155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:41.265024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a3e6f45c-92cc-4f66-a81a-0a64dcf36f6f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.181900 Jun 24 23:49:41.265591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 95/171] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:41 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:41.367009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:41.374543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2f81c868-24bf-4ffb-824c-232dac8531d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1315 microversion: 2.1 time: 0.337306 Jun 24 23:49:41.375095 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 77/172] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:41 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:41.631527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:41.632130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:41.638874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.639314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.640094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.640543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.769313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:41.776861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c8acf8c6-19ee-4d72-b460-78fd7288554c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.149610 Jun 24 23:49:41.777421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 96/173] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:41 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:41.950935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:41.951915 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:41.959280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.959954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.961015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.961666 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.969138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:41.969647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:41.986549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.987150 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:41.988066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:41.988517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.136367 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.145616 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.147380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.148541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-165e1e67-de26-46d2-9867-da53ab044546 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.203013 Jun 24 23:49:42.158614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 78/174] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:41 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:42.165237 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-511a2e45-267e-4077-8e1a-ab9d24bdd068 req-7bffd39e-cba9-4402-8123-d292040c8b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266fe95-e867-4be8-a5c5-8f60b19e1cb6", "name": "network-vif-plugged", "status": "completed", "tag": "24ec8691-f6ed-4396-85ee-c50a25b71b9a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:42.183686 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-511a2e45-267e-4077-8e1a-ab9d24bdd068 req-7bffd39e-cba9-4402-8123-d292040c8b18 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.187211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-511a2e45-267e-4077-8e1a-ab9d24bdd068 req-7bffd39e-cba9-4402-8123-d292040c8b18 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.203491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-511a2e45-267e-4077-8e1a-ab9d24bdd068 req-7bffd39e-cba9-4402-8123-d292040c8b18 service nova] Creating event network-vif-plugged:24ec8691-f6ed-4396-85ee-c50a25b71b9a for instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 on hv-cinder-84762 Jun 24 23:49:42.208534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-511a2e45-267e-4077-8e1a-ab9d24bdd068 req-7bffd39e-cba9-4402-8123-d292040c8b18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048681 Jun 24 23:49:42.209169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 79/175] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:42.225196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.233165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-660dd9de-b69e-4434-92be-748a48f0fa2e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1322 microversion: 2.1 time: 0.271057 Jun 24 23:49:42.233725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 97/176] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:41 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:42.282756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:42.283525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:42.290084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.290549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.291376 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.291827 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.392088 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:42.392787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:42.399262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.399765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.400524 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.401190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.422124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.430420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-de83d79c-6bda-475b-85df-e780089d0dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.151674 Jun 24 23:49:42.430978 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 80/177] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:42 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:42.579704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.587240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8d3a6642-69f1-4b25-9e59-4f8a8440fb2b tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1503 microversion: 2.1 time: 0.199823 Jun 24 23:49:42.587801 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 98/178] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:42 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:42.794020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:42.794645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:42.800640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.801101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.802040 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:42.802473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:42.806439 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:42.953498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:42.968195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b711c853-db2b-41fb-9cb4-c8cf13c9fc45 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.178503 Jun 24 23:49:42.968810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 81/179] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:42 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:43.173777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:43.174378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.180766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.181412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.182172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.182790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.250186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:43.251016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.257935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.258387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.259152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.259586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.344759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.352717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.354288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.355490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dc2f2ae4-bbf7-45c7-9602-13d6f02a46f9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.185522 Jun 24 23:49:43.356688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 99/180] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:43 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:43.411626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.419372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-de95de2e-0416-4e1b-a69e-193aa7ad47a5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1515 microversion: 2.1 time: 0.173604 Jun 24 23:49:43.419872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 82/181] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:43 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:43.436363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:43.437512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.443386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.443823 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.444618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.445050 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.446895 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:43.447511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.454000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.454444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.455204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.455643 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.506437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'flavor' on Instance uuid 6babba1a-e4d5-4053-90c2-d201309bd0db {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:49:43.587170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.594555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-329bf8ec-563b-4b08-9f15-bfa4c12d27b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.151307 Jun 24 23:49:43.595128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 83/182] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:43 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:43.626784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2209f12e-b4dd-4266-b316-7288e5f7ba40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db/action" status: 200 len: 32 microversion: 2.1 time: 0.194844 Jun 24 23:49:43.627384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 100/183] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:49:43 2022] POST /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:49:43.636197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:43.636877 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.643355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.643805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.644562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.645027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.772741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:43.781317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-831c3efb-5be1-44f9-99cb-bccc46dc6f92 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.148763 Jun 24 23:49:43.781954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 84/184] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:43 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:43.985975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:43.986612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:43.992751 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.993192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:43.993940 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:43.994369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.124852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.128475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:44.133749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8553d29f-40c6-4e0e-8279-ed723eeba006 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.152171 Jun 24 23:49:44.134437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 101/185] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:43 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:44.373238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:44.373851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:44.380034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.380483 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.381342 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.381777 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.508669 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.517137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.518634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.519716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-17ab79b6-3784-4464-8077-f4432a8b8727 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.150687 Jun 24 23:49:44.520257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 85/186] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:44 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:44.611704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:44.612306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:44.619519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.619956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.620728 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.621154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.748247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.755740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ae75f2dc-a1b7-4f97-9cd6-c25a5898cb16 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.147853 Jun 24 23:49:44.756298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 102/187] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:44 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:44.799012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:44.799633 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:44.805647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.806098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.806862 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:44.807294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:44.943875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:44.952025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2120299a-eeb0-4f5e-a27b-1864fe0a4659 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.157042 Jun 24 23:49:44.952607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 86/188] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:44 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:45.151174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:45.151780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:45.164319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.164796 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.165555 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.165984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.295230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:45.302516 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a3070988-3d5d-4e49-9e4b-af3594bec2e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.155353 Jun 24 23:49:45.303067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 103/189] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:45 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:45.538451 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:45.539139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:45.545373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.545823 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.546592 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.547029 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.672694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:45.680522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:45.682060 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:45.683194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cf260102-3c49-4993-941b-58fed2e75b3c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.148666 Jun 24 23:49:45.684249 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 87/190] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:45 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:45.772690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:45.773285 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:45.779250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.779689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.780433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.780895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.916357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:45.924360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1001f4b1-7036-46f6-ad6a-51fa05eab393 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.155833 Jun 24 23:49:45.924953 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 104/191] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:45 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:45.969290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:45.969888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:45.975753 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.976209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:45.976975 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:45.977403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.109234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:46.116706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-390489a7-51e4-47fa-ac38-0dd4674888e6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.151715 Jun 24 23:49:46.117261 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 88/192] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:45 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:46.319536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:46.320102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:46.326864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.327314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.328259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.328763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.535470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:46.543299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dd984453-e4e5-4d52-84b8-0eb4553854f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.227744 Jun 24 23:49:46.544710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 105/193] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:46 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:46.702058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:46.702689 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:46.708604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.709050 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.709800 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.710231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.840417 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:46.849248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:46.851115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:46.852605 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9af4f623-595f-4afc-acf3-71f4b74675cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.154752 Jun 24 23:49:46.853159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 89/194] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:46 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:46.941930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:46.942537 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:46.948414 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.948889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:46.949749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:46.950179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.092361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:47.101488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f3730a67-245a-41a6-96fa-eb06638840b5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.164308 Jun 24 23:49:47.102063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 106/195] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:46 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:47.125359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89c7254-75d8-4bf0-b2c6-a16f183173ce"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:47.126588 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:47.133648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.134447 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:47.134571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.135207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:47.135307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.135687 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.142495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.143079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.143979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.144543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.295131 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:47.302483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-883a6c5a-9659-4863-8059-9cb495b92f5e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.172064 Jun 24 23:49:47.303042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 107/196] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:47 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:47.560154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:47.560787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:47.566734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.567178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.567925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.568350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.697142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:47.705741 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-762caa85-3ff6-4e65-857c-8a17baf84739 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.149385 Jun 24 23:49:47.706316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 108/197] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:47 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:47.870810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:47.871908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:47.877851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.878299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:47.879049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:47.879481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.006597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.015244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.016791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.017888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-98737bfc-1cbe-4409-ad37-f0262f9172b8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.150975 Jun 24 23:49:48.018442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 109/198] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:47 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:48.117641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:48.118259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:48.124825 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.125276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.126040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.126477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.258476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.266487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d36677db-3630-42a5-879e-ca04ecacb610 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.152574 Jun 24 23:49:48.267045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 110/199] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:48 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:48.319037 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:48.319635 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:48.326002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.326450 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.327207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.327639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.453349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.460672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2f3d6085-fc7d-4838-9029-972fdaa6875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.145297 Jun 24 23:49:48.461224 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 111/200] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:48 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:48.724137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:48.724767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:48.731266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.731790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.732542 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:48.732998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:48.859746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:48.867101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c035d1e1-8e87-46bf-a004-c85663a33da8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.146776 Jun 24 23:49:48.867660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 112/201] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:48 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:49.035926 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:49.036527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:49.042415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.042922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.044193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.044649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.173349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:49.181077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:49.182571 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:49.183666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-18b08c00-4cc8-4437-8eb7-49c39a4895a8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.151735 Jun 24 23:49:49.184206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 113/202] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:49 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:49.283569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:49.284175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:49.290182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.290580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.291327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.291756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.419539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:49.426870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2613c237-49d3-4081-a00b-b93b93507226 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1362 microversion: 2.1 time: 0.147065 Jun 24 23:49:49.427437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 114/203] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:49 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:49.477402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:49.478005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:49.484398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.484885 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.485780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.486215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.615904 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:49.623510 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-05cf075d-63f6-47dc-8981-15d885417f79 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.149715 Jun 24 23:49:49.624069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 115/204] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:49 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:49.884800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:49.885417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:49.891733 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.892286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:49.893087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:49.893511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.039718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.051755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-299fbcd7-aa58-446a-8eda-730f25adb9d6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.171284 Jun 24 23:49:50.052366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 116/205] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:49 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:50.202133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:50.202776 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:50.208717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.209163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.209923 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.210357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.338936 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.346778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.348290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.349453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6fc86dc7-56a8-4782-a992-811a0b896085 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1407 microversion: 2.20 time: 0.151848 Jun 24 23:49:50.350010 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 117/206] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:50 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:49:50.443520 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:50.444125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:50.450214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.450662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.451514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.452051 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.498713 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:49:50.619738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.627288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ed5d2344-c443-47c5-8e15-d43783fde283 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1547 microversion: 2.1 time: 0.187887 Jun 24 23:49:50.627868 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 118/207] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:50 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:50.639526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:50.640551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:50.646457 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.646897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.647971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.648341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.791241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:50.799443 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-78d6725f-eacd-4dd1-b896-cf96dd684e98 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.164353 Jun 24 23:49:50.800176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 119/208] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:50 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:50.804700 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:50.805184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:50.810678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.811081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.811832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:50.812380 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:50.890613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-844d53b1-87f6-484e-94a2-370318316595 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089314 Jun 24 23:49:50.891193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 120/209] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:49:50 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:51.069462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:51.070318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:51.077326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.077983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.078925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.079465 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.290300 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:51.315174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-efb850d9-da5c-460b-a5ca-5834796aa788 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.249691 Jun 24 23:49:51.329626 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 121/210] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:51 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:51.380744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:51.381372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:51.400460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.400852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.401705 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.402176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.459192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-721db772-69b3-44ab-92a9-42f26dadeee4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "POST /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.338176 Jun 24 23:49:51.460924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 90/211] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:49:47 2022] POST /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d/os-volume_attachments => generated 194 bytes in 4340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:51.609471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:51.618347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:51.630423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:51.631618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bb6856c4-95f8-4ee1-b9ec-8a957908a821 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1600 microversion: 2.20 time: 0.268090 Jun 24 23:49:51.632681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 122/212] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:49:51 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1600 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:49:51.658203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:51.658754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:51.669866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.670541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.671727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.672530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.816256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:51.817318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:51.823875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.824930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.825804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:51.826243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:51.849388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-79078855-ae55-4bd4-8331-50e5c7990f18 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.203151 Jun 24 23:49:51.850354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 91/213] 10.222.0.47 () {60 vars in 1315 bytes} [Fri Jun 24 23:49:51 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:49:52.340273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:52.347534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:52.348212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:52.354444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f67c7c3e-16be-4da9-bc1c-cfc2477bf715 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.539327 Jun 24 23:49:52.355161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 123/214] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:51 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:52.361680 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:52.362144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:52.363121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:52.363566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:52.694260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:52.705218 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4d572c20-cea2-406c-8135-a86d282a38ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.362446 Jun 24 23:49:52.716074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 92/215] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:52 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:53.337197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-3da993e9-5d13-41e4-8d66-cf8c887f399e req-8b4ad12d-2dc9-4089-92b4-b80bb7a1330b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5", "tag": "a24eac32-170f-4a97-ad18-9d87820319c1"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:53.347304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-3da993e9-5d13-41e4-8d66-cf8c887f399e req-8b4ad12d-2dc9-4089-92b4-b80bb7a1330b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.347949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-3da993e9-5d13-41e4-8d66-cf8c887f399e req-8b4ad12d-2dc9-4089-92b4-b80bb7a1330b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.368551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-3da993e9-5d13-41e4-8d66-cf8c887f399e req-8b4ad12d-2dc9-4089-92b4-b80bb7a1330b service nova] Creating event network-changed:a24eac32-170f-4a97-ad18-9d87820319c1 for instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 on hv-cinder-84762 Jun 24 23:49:53.375243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-3da993e9-5d13-41e4-8d66-cf8c887f399e req-8b4ad12d-2dc9-4089-92b4-b80bb7a1330b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041578 Jun 24 23:49:53.376145 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 124/216] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:53.376312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:53.377211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:53.389737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.390197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.390970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.391624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.602643 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:53.611513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8df902a8-4dc7-4948-9332-9ea8c537652b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.243139 Jun 24 23:49:53.614733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 93/217] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:53 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:53.725096 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:53.726085 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:53.736007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.736673 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.737641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.738695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.795166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-5a07a198-93c8-4685-9768-9edd65dd9956 req-f0cbfc38-8d97-4671-be64-f651f567a325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:53.809557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5a07a198-93c8-4685-9768-9edd65dd9956 req-f0cbfc38-8d97-4671-be64-f651f567a325 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:53.811846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5a07a198-93c8-4685-9768-9edd65dd9956 req-f0cbfc38-8d97-4671-be64-f651f567a325 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:53.844689 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-5a07a198-93c8-4685-9768-9edd65dd9956 req-f0cbfc38-8d97-4671-be64-f651f567a325 service nova] Creating event network-changed:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:49:53.856351 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-5a07a198-93c8-4685-9768-9edd65dd9956 req-f0cbfc38-8d97-4671-be64-f651f567a325 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065200 Jun 24 23:49:53.861123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 94/218] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:49:54.061814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:54.073822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2240346c-53af-45bb-8e47-b01f5581bb47 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1365 microversion: 2.1 time: 0.351878 Jun 24 23:49:54.075126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 125/219] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:53 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:54.632386 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:54.633265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:54.644158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:54.649418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:54.650592 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:54.651141 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:55.091925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:55.092654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:55.103493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:55.104447 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:55.107246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:55.109351 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:55.351142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:55.363491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d7323714-4fba-4618-a501-87cfccc37dad tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1556 microversion: 2.1 time: 0.275886 Jun 24 23:49:55.364632 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 126/220] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:55 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:49:55.385775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:55.387813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:55.430295 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:55.430751 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:55.432020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:55.432457 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:55.654507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-38588238-8606-4bc5-a857-9437af058a9f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274210 Jun 24 23:49:55.655444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 127/221] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:49:55 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:55.738818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:55.747474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-17e79b4a-e0fa-465a-8fd6-7bb1c1362761 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 1.120090 Jun 24 23:49:55.760310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 95/222] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:54 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:56.770015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:56.770622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:56.780828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:56.782961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:56.784547 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:56.786036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:57.088927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:57.097902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c39db40a-175a-4323-af9d-eea67ff0248a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.332929 Jun 24 23:49:57.109420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 128/223] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:56 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:57.454811 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-00ceb9c5-19db-4db7-9bf2-542273a06b80 req-9ed74359-dc39-4968-8bb2-e8e16eef2d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266fe95-e867-4be8-a5c5-8f60b19e1cb6", "tag": "24ec8691-f6ed-4396-85ee-c50a25b71b9a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:49:57.466387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-00ceb9c5-19db-4db7-9bf2-542273a06b80 req-9ed74359-dc39-4968-8bb2-e8e16eef2d72 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:57.467545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-00ceb9c5-19db-4db7-9bf2-542273a06b80 req-9ed74359-dc39-4968-8bb2-e8e16eef2d72 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:57.481005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-00ceb9c5-19db-4db7-9bf2-542273a06b80 req-9ed74359-dc39-4968-8bb2-e8e16eef2d72 service nova] Creating event network-changed:24ec8691-f6ed-4396-85ee-c50a25b71b9a for instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 on hv-cinder-84762 Jun 24 23:49:57.487169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-00ceb9c5-19db-4db7-9bf2-542273a06b80 req-9ed74359-dc39-4968-8bb2-e8e16eef2d72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038944 Jun 24 23:49:57.488359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 96/224] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:49:58.117136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:58.117818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:58.128272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:58.128805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:58.131268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:58.131834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:58.671557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:58.679302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-21742f06-f156-4e41-af98-869fc0e37f6d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.568051 Jun 24 23:49:58.688651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 129/225] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:58 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:49:59.708323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:49:59.709486 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:49:59.717648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:59.718120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:59.719208 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:49:59.719796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:49:59.878359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:49:59.889319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9cfd140d-5bc1-4d45-866e-745d8e43fbd1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.186074 Jun 24 23:49:59.891030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 97/226] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:49:59 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:00.906928 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:00.907533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:00.917372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:00.920334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:00.921198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:00.921627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:01.079679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:01.087326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bd439c7d-28f5-4c3d-a979-2708e1bdc8ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.184193 Jun 24 23:50:01.087876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 130/227] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:00 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:01.450256 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:01.450832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:01.458005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:01.458699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:01.459695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:01.460333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:01.465594 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:01.496859 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:50:01.608492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7af7cde8-d097-441a-b79d-5a8a42cc15e4 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 204 len: 0 microversion: 2.1 time: 0.161666 Jun 24 23:50:01.609539 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 98/228] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:50:01 2022] DELETE /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:50:01.619097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:01.619710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:01.623809 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:01.628442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:01.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:01.630019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:01.630750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:01.775212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:01.783723 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-83eb61eb-694c-497f-8a52-3116448ca8a7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1555 microversion: 2.1 time: 0.169002 Jun 24 23:50:01.792815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 131/229] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:01 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:02.106233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:02.107669 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:02.114089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:02.115320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:02.116498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:02.116943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:02.258196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:02.267537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-34f5fe60-ae9f-4e49-9728-f6530055eb1a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.166758 Jun 24 23:50:02.268215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 99/230] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:02 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:02.801762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:02.802286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:02.808681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:02.809146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:02.809911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:02.810344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:02.940574 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:02.949243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fe32968c-f829-454f-9635-103db62a38d0 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1555 microversion: 2.1 time: 0.151006 Jun 24 23:50:02.949866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 132/231] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:02 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:03.285631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:03.286793 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:03.293820 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:03.294766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:03.295381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:03.296102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:03.460421 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:03.468429 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-30051d81-77d9-41ad-b12a-1e0be17c60cc tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.187473 Jun 24 23:50:03.469022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 100/232] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:03 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:03.966909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:03.968082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:03.974938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:03.975567 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:03.976678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:03.977265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:04.193213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:04.204204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9c6f7aae-c3e1-4168-9f9f-d7d527977a39 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1555 microversion: 2.1 time: 0.241802 Jun 24 23:50:04.205708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 133/233] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:03 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:04.414532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-af500d3d-de79-4e98-906d-38feb09e617a req-f9c0f342-ca17-4773-b29a-f2519fe5a01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df28f5e-1882-43bb-85e4-895c077b884d", "name": "network-vif-deleted", "tag": "99a72ef6-11cf-4c12-a6f0-c0c761487f2f"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:04.424631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-af500d3d-de79-4e98-906d-38feb09e617a req-f9c0f342-ca17-4773-b29a-f2519fe5a01e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:04.425304 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-af500d3d-de79-4e98-906d-38feb09e617a req-f9c0f342-ca17-4773-b29a-f2519fe5a01e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:04.442004 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-af500d3d-de79-4e98-906d-38feb09e617a req-f9c0f342-ca17-4773-b29a-f2519fe5a01e service nova] Creating event network-vif-deleted:99a72ef6-11cf-4c12-a6f0-c0c761487f2f for instance 6df28f5e-1882-43bb-85e4-895c077b884d on hv-cinder-84762 Jun 24 23:50:04.449608 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-af500d3d-de79-4e98-906d-38feb09e617a req-f9c0f342-ca17-4773-b29a-f2519fe5a01e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038792 Jun 24 23:50:04.450213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 101/234] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:04.485999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:04.486845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:04.499261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:04.499941 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:04.500761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:04.501210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:04.718719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:04.730683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0ac68c24-72a2-4988-a17a-20ea71927b28 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.248014 Jun 24 23:50:04.732310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 134/235] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:04 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:05.225333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:05.226465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:05.256693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:05.264651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:05.268742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:05.273906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:05.364997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:05.365966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:05.366609 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lazy-loading 'fault' on Instance uuid 6df28f5e-1882-43bb-85e4-895c077b884d {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:50:05.452194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151db87b1e7248d882108519fab1d938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4921002ea57c4f54a7a3b69d802a6430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:05.474584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-128e0834-78c2-44c3-be0b-4f12b7311b31 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 200 len: 1305 microversion: 2.1 time: 0.254663 Jun 24 23:50:05.475788 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 102/236] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:05 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 1305 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:05.749557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:05.750367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:05.757759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:05.758373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:05.759369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:05.759990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:05.912637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:05.922415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-590c350b-b911-4022-ab5d-d9c742b95212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.177403 Jun 24 23:50:05.922990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 135/237] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:05 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:06.496522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:06.497322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:06.504813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.505262 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:06.506026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.506654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:06.521530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] HTTP exception thrown: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Request method failure captured: Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d HTTP/1.1 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1meg5OJcs2P3UjF1vwlCAlbhjMl0zGFZWkyxsYlOMGh0cRlyjOt_W1n2MF3zurlEXwpbgZX9kcL1vlCzXKtVpv9r_9XjFhmLs14BewEOKPTwQUc6OejZlHHBEyQY4NuluV0P2KkGETHZOk44JQcgaqTCGmA1MVTqGjR4YfxTNKJxg Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:50:06.533280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}] Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 151db87b1e7248d882108519fab1d938 Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.534678 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '6df28f5e-1882-43bb-85e4-895c077b884d'} Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:50:06.535530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.536663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.537627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Returning 404 to user: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:50:06.537627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4008dc66-25ca-4f17-9b01-0180e9ed8ac7 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 404 len: 111 microversion: 2.1 time: 0.045049 Jun 24 23:50:06.537627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 103/238] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:06 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:50:06.659710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:06.661477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:06.670879 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.671511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:06.672866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.673452 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:06.690561 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] HTTP exception thrown: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Request method failure captured: Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d/os-volume_attachments HTTP/1.1 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1meg5OJcs2P3UjF1vwlCAlbhjMl0zGFZWkyxsYlOMGh0cRlyjOt_W1n2MF3zurlEXwpbgZX9kcL1vlCzXKtVpv9r_9XjFhmLs14BewEOKPTwQUc6OejZlHHBEyQY4NuluV0P2KkGETHZOk44JQcgaqTCGmA1MVTqGjR4YfxTNKJxg Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:50:06.701771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}] Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 151db87b1e7248d882108519fab1d938 Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.702982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'server_id': '6df28f5e-1882-43bb-85e4-895c077b884d'} Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:50:06.703866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:06.705099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:06.706666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Returning 404 to user: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:50:06.706666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7b3d9061-68c2-478c-a8a9-0888f12b5781 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049055 Jun 24 23:50:06.706666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 136/239] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:50:06 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:50:06.940373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:06.941096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:06.948854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.949327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:06.950087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:06.950547 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:07.226372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:07.240628 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-84b9e3cb-a0e5-45c4-beea-c5f0dc3e751f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.305069 Jun 24 23:50:07.247954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 104/240] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:06 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:07.972697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:07.973272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:07.979716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:07.980252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:07.981343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:07.981848 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:07.987241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:07.999848 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] HTTP exception thrown: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Request method failure captured: Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d HTTP/1.1 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1meg5OJcs2P3UjF1vwlCAlbhjMl0zGFZWkyxsYlOMGh0cRlyjOt_W1n2MF3zurlEXwpbgZX9kcL1vlCzXKtVpv9r_9XjFhmLs14BewEOKPTwQUc6OejZlHHBEyQY4NuluV0P2KkGETHZOk44JQcgaqTCGmA1MVTqGjR4YfxTNKJxg Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:50:08.002288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}] Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 151db87b1e7248d882108519fab1d938 Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.003479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '6df28f5e-1882-43bb-85e4-895c077b884d'} Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:50:08.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.005750 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.006864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Returning 404 to user: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:50:08.006864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-429411f2-b040-406c-ba50-8c5ff01c9a24 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 404 len: 111 microversion: 2.1 time: 0.035882 Jun 24 23:50:08.006864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 137/241] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:50:07 2022] DELETE /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:50:08.012827 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:08.013572 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] [instance: 6df28f5e-1882-43bb-85e4-895c077b884d] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:08.019746 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:08.020203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:08.021123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:08.021681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:08.037360 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] HTTP exception thrown: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Request method failure captured: Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d HTTP/1.1 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1meg5OJcs2P3UjF1vwlCAlbhjMl0zGFZWkyxsYlOMGh0cRlyjOt_W1n2MF3zurlEXwpbgZX9kcL1vlCzXKtVpv9r_9XjFhmLs14BewEOKPTwQUc6OejZlHHBEyQY4NuluV0P2KkGETHZOk44JQcgaqTCGmA1MVTqGjR4YfxTNKJxg Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:50:08.039634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4921002ea57c4f54a7a3b69d802a6430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4921002ea57c4f54a7a3b69d802a6430"}]}] Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 4921002ea57c4f54a7a3b69d802a6430 Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304300299 Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 151db87b1e7248d882108519fab1d938 Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-DeleteServersTestJSON-1304300299-project Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.041333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '6df28f5e-1882-43bb-85e4-895c077b884d'} Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:50:08.042258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. Jun 24 23:50:08.043676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:50:08.046419 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] Returning 404 to user: Instance 6df28f5e-1882-43bb-85e4-895c077b884d could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:50:08.047629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-52f005f2-26e2-4d70-8b84-6223fc5cdf41 tempest-DeleteServersTestJSON-1304300299 tempest-DeleteServersTestJSON-1304300299-project] 10.222.0.47 "GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d" status: 404 len: 111 microversion: 2.1 time: 0.038902 Jun 24 23:50:08.048328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 105/242] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:08 2022] GET /compute/v2.1/servers/6df28f5e-1882-43bb-85e4-895c077b884d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:50:08.267420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:08.268040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:08.279936 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:08.280706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:08.282035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:08.282930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:08.551787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:08.564293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-59684730-117f-46dc-a601-ce418f25c759 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.299874 Jun 24 23:50:08.565042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 138/243] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:08 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:09.584122 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:09.586487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:09.596298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:09.602963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:09.603866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:09.605213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:09.605842 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:09.702804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1847892624", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "networks": [{"uuid": "04987f12-459b-4dbd-bcc7-f34382b6c1a1"}]}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:09.763748 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] validate_networks() for [('04987f12-459b-4dbd-bcc7-f34382b6c1a1', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:50:09.945384 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:09.957378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b6caa7bd-3653-4001-b192-6c0db817c212 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.379574 Jun 24 23:50:09.968999 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 106/244] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:09 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:10.288001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:50:10.288494 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:50:10.289078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:50:10.289549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:50:10.290025 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:50:10.305493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:10.305950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:10.306765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:10.307210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:10.374032 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Getting quotas for project b45f691b51284dbbb7f1fd8d482af7e4. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:50:10.384935 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Getting quotas for user 6e416196a4614ccc90c8f2411e3f0258 and project b45f691b51284dbbb7f1fd8d482af7e4. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:50:10.408255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:50:10.410588 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:50:10.476492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ca0a9bcd-e512-4e62-a863-4150f98c22f2 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778972 Jun 24 23:50:10.478393 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 139/245] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:50:10.488166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-edc4b437-59f2-40ee-ac80-bf8f6845a8ed tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:10.489076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-edc4b437-59f2-40ee-ac80-bf8f6845a8ed tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:10.660050 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-edc4b437-59f2-40ee-ac80-bf8f6845a8ed tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:10.678718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-edc4b437-59f2-40ee-ac80-bf8f6845a8ed tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1219 microversion: 2.1 time: 0.194660 Jun 24 23:50:10.679909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 107/246] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:10 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:10.978212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:10.980263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:10.991297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:10.994133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:10.997762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:10.998620 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:11.253992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:11.264219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6d92db70-fb85-4b9a-81c4-122250eab8ba tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.292252 Jun 24 23:50:11.265093 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 140/247] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:10 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:11.700679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:11.702197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:11.725257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:11.726112 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:11.727279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:11.728809 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:11.799667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:11.811381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f37baf86-e8fa-41d7-b763-5fd5999e479d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1271 microversion: 2.1 time: 0.116840 Jun 24 23:50:11.812030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 108/248] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:11 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:12.285640 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:12.286938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:12.298215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:12.299160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:12.299978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:12.304337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:12.751009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:12.765980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aa4c11f7-fcd3-4763-8638-da27c38200a3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.485898 Jun 24 23:50:12.766578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 141/249] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:12 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:12.829730 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:12.833261 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:12.840658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:12.841587 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:12.843042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:12.843684 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:12.924190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:12.942938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-48ef1176-b844-44ac-bb6a-626ba7bdc8e6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1277 microversion: 2.1 time: 0.111753 Jun 24 23:50:12.943580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 109/250] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:12 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:13.266933 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-15993613", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:13.332322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] validate_networks() for None {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:50:13.671252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:50:13.671789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:50:13.672266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:50:13.672699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:50:13.673111 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:50:13.685199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.685678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:13.686480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.686914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:13.704761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Getting quotas for project 07b87adb66004fb39c8558287d1bee98. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:50:13.709415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Getting quotas for user ac07e1b2de6f4607a37047b6edee4704 and project 07b87adb66004fb39c8558287d1bee98. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:50:13.720109 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:50:13.722261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:50:13.768792 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-71da830d-4d45-4b16-ad0e-78165e62c296 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505965 Jun 24 23:50:13.769660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 142/251] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:50:13.781330 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e9753fe6-2757-4fe2-8624-4820c331b721 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:13.782265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e9753fe6-2757-4fe2-8624-4820c331b721 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:13.782837 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:13.783443 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:13.800085 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.800644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:13.804834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.805402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:13.904478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e9753fe6-2757-4fe2-8624-4820c331b721 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:13.912455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e9753fe6-2757-4fe2-8624-4820c331b721 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1213 microversion: 2.1 time: 0.136662 Jun 24 23:50:13.913682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 110/252] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:13 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:13.961410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:13.977009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:13.992537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.993349 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:13.994468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:13.996524 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:14.015705 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:14.023992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7068f434-0941-4380-b94e-b7eaf335f3d2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.244855 Jun 24 23:50:14.028904 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 143/253] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:13 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:14.213963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-13a6ee1e-4650-4c82-ac2c-386b59ddc111 req-c033c508-cae8-4768-864e-025f238de8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0d0fd-71fd-43de-91fd-5baa71d19f16", "tag": "4b56b985-63bb-4183-8814-6013082f135a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:14.228889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-13a6ee1e-4650-4c82-ac2c-386b59ddc111 req-c033c508-cae8-4768-864e-025f238de8dc service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:14.230295 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-13a6ee1e-4650-4c82-ac2c-386b59ddc111 req-c033c508-cae8-4768-864e-025f238de8dc service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:14.243021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-13a6ee1e-4650-4c82-ac2c-386b59ddc111 req-c033c508-cae8-4768-864e-025f238de8dc service nova] Creating event network-changed:4b56b985-63bb-4183-8814-6013082f135a for instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 on hv-cinder-84762 Jun 24 23:50:14.250748 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-13a6ee1e-4650-4c82-ac2c-386b59ddc111 req-c033c508-cae8-4768-864e-025f238de8dc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040890 Jun 24 23:50:14.252859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 144/254] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:14.328007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:14.336880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cbf8f45d-b108-4166-8950-e6042fc53189 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.380360 Jun 24 23:50:14.337641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 111/255] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:13 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:14.937939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:14.938732 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:14.947815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:14.949129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:14.950090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:14.950521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:15.030412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:15.039590 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-441bacbe-0c44-410f-be71-719fa04d816d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1265 microversion: 2.1 time: 0.111978 Jun 24 23:50:15.040743 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 145/256] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:14 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:15.056291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:15.062229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:15.069434 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:15.069978 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:15.070970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:15.071769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:15.225600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:15.233557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-282ff43b-cd6d-4b02-81c0-60cbc60c64a8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.195358 Jun 24 23:50:15.234122 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 112/257] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:15 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:15.353342 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:15.353954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:15.360378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:15.360864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:15.361631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:15.362062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:15.495895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:15.503425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d02ad609-7163-46e2-8d11-b3f6d76528d7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.153983 Jun 24 23:50:15.503996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 146/258] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:15 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:16.059760 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:16.060594 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:16.068647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.069224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.070057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.070549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.250477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:16.251023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:16.257680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.258203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.259078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.259644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.280629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:16.290223 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-600213d4-5452-4267-8db5-ed0eccce29af tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1273 microversion: 2.1 time: 0.235609 Jun 24 23:50:16.290789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 113/259] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:16 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:16.397213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:16.406481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7d9025ee-c174-4860-9f49-bb932f9ed46d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.159982 Jun 24 23:50:16.407531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 147/260] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:16 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:16.521671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:16.523000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:16.529920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.530487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.531319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:16.531840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:16.983420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:16.991163 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-789fb23e-aa6f-45ad-98ff-41a17cfe580b tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.473477 Jun 24 23:50:16.991723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 114/261] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:16 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:17.308155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:17.309446 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:17.317698 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:17.318242 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:17.319087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:17.319591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:17.382964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:17.390842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cb176ffc-1b91-44d9-ae80-378522747c5f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1271 microversion: 2.1 time: 0.086873 Jun 24 23:50:17.391394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 148/262] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:17 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:17.423521 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:17.424151 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:17.430010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:17.430457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:17.431210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:17.431640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:17.570338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:17.578370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0c5e482e-f89d-4409-aaf3-35eb91621e29 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.158833 Jun 24 23:50:17.578981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 115/263] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:17 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:18.008185 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:18.009048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:18.017544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.018358 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.019922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.020509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.262762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:18.273765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e704f1ca-33e3-4f96-ba0f-fa6045d79477 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.269486 Jun 24 23:50:18.274861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 149/264] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:18 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:18.409455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:18.410138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:18.417270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.417995 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.419145 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.419875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.538902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:18.541261 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:18.549943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-831726e4-b50a-4660-a0c0-8b1850ae5491 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1271 microversion: 2.1 time: 0.144939 Jun 24 23:50:18.550520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 116/265] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:18 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:18.597731 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:18.598954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:18.607289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.608027 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.609345 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:18.609734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:18.903631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:18.911879 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-79572bb5-5668-4062-9f90-13c0ec666ef9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.320080 Jun 24 23:50:18.913126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 150/266] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:18 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:19.291203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:19.292433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:19.299148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.299631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:19.300473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.300936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:19.436945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:19.444271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8f77897d-ead3-4843-85ec-ffc41507c343 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.157354 Jun 24 23:50:19.445061 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 117/267] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:19 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:19.567181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:19.567843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:19.574568 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.575007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:19.575767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.576193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:19.711718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:19.719360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a95f45f3-30a8-47af-9cf9-f766a021031f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.156257 Jun 24 23:50:19.719914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 151/268] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:19 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:19.929362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:19.929976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:19.936862 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.937309 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:19.938080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:19.938523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:20.120460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:20.128494 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ee54258c-a86d-480c-a009-398b6290c496 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.202947 Jun 24 23:50:20.129177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 118/269] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:19 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:20.460244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:20.460891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:20.467167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:20.467622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:20.468387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:20.468888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:20.608968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:20.616701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1f00ab7c-bc23-4ca1-a928-80fbe8c7ee81 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.160323 Jun 24 23:50:20.617595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 152/270] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:20 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:20.736354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:20.736892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:20.743224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:20.743675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:20.744436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:20.746019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:20.938832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:20.946831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9debf7ef-81f5-4f86-a724-ea3bb2b94fe3 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.214966 Jun 24 23:50:20.947489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 119/271] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:20 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:21.145361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:21.145974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:21.157105 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.157787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.158608 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.159400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.364784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:21.374982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ee0ea434-8efc-4e81-8268-0ca67dca9815 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1521 microversion: 2.1 time: 0.233364 Jun 24 23:50:21.377730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 153/272] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:21 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:21.633812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:21.634420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:21.641482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.641981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.642927 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.643363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.668470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-ce2d8b62-f0af-4770-92a6-db8283cc260e req-1e4e24a8-c61b-4335-a205-02b9db2f5f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1", "tag": "55dc9d6d-8f22-4908-a0a9-33b07aec4d87"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:21.682867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ce2d8b62-f0af-4770-92a6-db8283cc260e req-1e4e24a8-c61b-4335-a205-02b9db2f5f8d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.683684 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ce2d8b62-f0af-4770-92a6-db8283cc260e req-1e4e24a8-c61b-4335-a205-02b9db2f5f8d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.697314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-ce2d8b62-f0af-4770-92a6-db8283cc260e req-1e4e24a8-c61b-4335-a205-02b9db2f5f8d service nova] Creating event network-changed:55dc9d6d-8f22-4908-a0a9-33b07aec4d87 for instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 on hv-cinder-84762 Jun 24 23:50:21.704127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-ce2d8b62-f0af-4770-92a6-db8283cc260e req-1e4e24a8-c61b-4335-a205-02b9db2f5f8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041335 Jun 24 23:50:21.705202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 154/273] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:50:21.810636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:21.819614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ef1b52dd-f768-46e0-9da0-23e4aa95d6fe tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.189501 Jun 24 23:50:21.820498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 120/274] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:21 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:21.964348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:21.965711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:21.972454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.973144 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:21.974141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:21.974626 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.131168 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:22.139010 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f4650b27-c73b-480a-9997-dd34a068d9f9 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.178963 Jun 24 23:50:22.139591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 155/275] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:21 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:22.402097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:22.402711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:22.419189 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.419653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.420459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.420933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.572758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:22.575428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-eb734d42-ce2a-43dd-b1d8-91e1ade11bea req-c111a756-7fa8-4af5-86e1-2777c9e24933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0d0fd-71fd-43de-91fd-5baa71d19f16", "name": "network-vif-plugged", "status": "completed", "tag": "4b56b985-63bb-4183-8814-6013082f135a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:22.584645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-eb734d42-ce2a-43dd-b1d8-91e1ade11bea req-c111a756-7fa8-4af5-86e1-2777c9e24933 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.585446 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-eb734d42-ce2a-43dd-b1d8-91e1ade11bea req-c111a756-7fa8-4af5-86e1-2777c9e24933 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.587350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6e2c30e8-04e7-4bb4-9cf2-96da6cb62ccd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1501 microversion: 2.1 time: 0.196048 Jun 24 23:50:22.588089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 121/276] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:22 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:22.600033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-eb734d42-ce2a-43dd-b1d8-91e1ade11bea req-c111a756-7fa8-4af5-86e1-2777c9e24933 service nova] Creating event network-vif-plugged:4b56b985-63bb-4183-8814-6013082f135a for instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 on hv-cinder-84762 Jun 24 23:50:22.606021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-eb734d42-ce2a-43dd-b1d8-91e1ade11bea req-c111a756-7fa8-4af5-86e1-2777c9e24933 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034902 Jun 24 23:50:22.607003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 156/277] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:50:22.611278 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:22.611891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:22.618054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.618511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.619307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.619831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.761988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:22.769687 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-07d34d79-46c7-42fb-86e5-45a7b7dfd530 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1515 microversion: 2.1 time: 0.163550 Jun 24 23:50:22.770345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 122/278] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:22 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:22.839431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:22.840378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:22.851276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.852079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:22.853075 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:22.861937 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:23.070671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:23.076040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:23.082531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9daef9a7-77f0-4109-b740-caaa909703b6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.248789 Jun 24 23:50:23.084299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 157/279] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:22 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:23.158524 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:23.159548 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:23.165491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:23.166054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:23.168246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:23.168962 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:23.328890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:23.336500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-20fb3bcc-5182-4823-8734-1f084b97332f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.182354 Jun 24 23:50:23.340331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 123/280] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:23 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:24.100736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:24.101384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:24.103178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:24.104449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=12 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:24.113140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.113140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.113302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.113687 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.273248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:24.279934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:24.281489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:24.290572 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.291247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.293265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.294010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.299066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:24.308774 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8873d68c-4bf9-41c1-8651-5ffef0a0d973 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.211676 Jun 24 23:50:24.311006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 158/281] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:24 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:24.322318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'flavor' on Instance uuid ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:50:24.356045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:24.357021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:24.363453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.363913 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.364828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.365605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.451867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8ff7f0e3-9568-4df8-a8fd-ba06c7ca78a2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/action" status: 200 len: 32 microversion: 2.1 time: 0.179898 Jun 24 23:50:24.453161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 124/282] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:50:24 2022] POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:50:24.464291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:24.465293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:24.472928 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.473663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.474529 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:24.475034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:24.575739 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:24.585772 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c08b6325-12cf-4664-8a30-a05cb76c5d4e tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.234289 Jun 24 23:50:24.586346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 159/283] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:24 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:24.819990 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:24.835047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1cf73211-eec6-41c1-9f93-b0f3adc075e0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.376965 Jun 24 23:50:24.836335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 125/284] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:24 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:25.328943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:25.330227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:25.336489 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.337236 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:25.338418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.339025 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:25.509793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:25.518221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-22e5a205-3b6c-46d0-a3a7-7bb3aae657a9 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1319 microversion: 2.1 time: 0.193725 Jun 24 23:50:25.518915 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 160/285] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:25 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:25.603573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:25.605447 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:25.612229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.612797 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:25.613838 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.614413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:25.857125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:25.857781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:25.864735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.865822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:25.866821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:25.867481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:26.050617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:26.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5a342b06-ba82-4168-87ef-ed6beec7856d tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.460194 Jun 24 23:50:26.059727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 126/286] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:25 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:26.103165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:26.115539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dbe60b24-c0ab-41ef-bbea-f47f18f853f1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.263791 Jun 24 23:50:26.116786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 161/287] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:25 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:26.537825 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:26.538551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:26.552384 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:26.553155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:26.554964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:26.556190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:26.687517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-675e0081-ee41-4c52-aadf-934ef1539ef3 req-6307cad6-32c6-44ff-93a4-5701fbcd747d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "55dc9d6d-8f22-4908-a0a9-33b07aec4d87"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:26.702163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-675e0081-ee41-4c52-aadf-934ef1539ef3 req-6307cad6-32c6-44ff-93a4-5701fbcd747d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:26.705092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-675e0081-ee41-4c52-aadf-934ef1539ef3 req-6307cad6-32c6-44ff-93a4-5701fbcd747d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:26.723197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-675e0081-ee41-4c52-aadf-934ef1539ef3 req-6307cad6-32c6-44ff-93a4-5701fbcd747d service nova] Creating event network-vif-plugged:55dc9d6d-8f22-4908-a0a9-33b07aec4d87 for instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 on hv-cinder-84762 Jun 24 23:50:26.729083 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-675e0081-ee41-4c52-aadf-934ef1539ef3 req-6307cad6-32c6-44ff-93a4-5701fbcd747d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045135 Jun 24 23:50:26.730051 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 162/288] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:50:26.898718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:26.909507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b6d97c66-417b-46b2-9a47-1b1b28c66788 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1508 microversion: 2.1 time: 0.376138 Jun 24 23:50:26.910184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 127/289] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:26 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:27.076681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:27.077680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:27.095260 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:27.098807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:27.101811 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:27.102329 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:27.135867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:27.136382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:27.159725 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:27.160422 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:27.161445 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:27.162199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:27.433608 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:27.448166 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e56d154c-641c-489d-b921-1494aa3ec63a tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.376038 Jun 24 23:50:27.449500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 163/290] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:27 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:27.524783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:27.534435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-36b628ab-d8dd-48d5-abe9-5c6bfaab3c27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.403508 Jun 24 23:50:27.535011 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 128/291] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:27 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:28.467422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:28.469246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:28.476546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:28.477101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:28.478074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:28.478562 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:28.554033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:28.554601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:28.567803 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:28.569642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:28.572236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:28.574607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:28.661228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:28.671418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e950919a-951e-499c-a7d8-f809fb56351f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.208798 Jun 24 23:50:28.672356 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 164/292] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:28 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:28.823040 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:28.837472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ca688aca-6a3c-4570-b9e7-4a7a1966fb9e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.284707 Jun 24 23:50:28.838834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 129/293] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:28 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:29.695505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:29.696990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:29.717157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:29.719730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:29.720624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:29.721147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:29.855649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:29.856963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:29.872326 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:29.883774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:29.888292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:29.897198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:29.921314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:29.934528 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-51aa0cf1-58bc-4c17-954c-4b15bde67d06 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1313 microversion: 2.1 time: 0.242962 Jun 24 23:50:29.945855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 165/294] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:29 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:30.210742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:30.219729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f3becf94-4732-458e-bae2-05c4f13dc456 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.369234 Jun 24 23:50:30.231283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 130/295] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:29 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:30.967348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:30.967988 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:30.974420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:30.974871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:30.975647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:30.976081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.133415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:31.142462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9349deb9-2e46-4b1c-b22e-490222748eaf tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1463 microversion: 2.1 time: 0.183442 Jun 24 23:50:31.143097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 166/296] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:30 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:31.187679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:31.187679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:31.194578 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.195232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.199561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.200012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.232956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:31.248190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:31.250226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:31.257654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:50:31.263372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:31.265287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.265883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.266657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.267094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.398442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2ee88ecc-1701-4679-aa2a-e13279dac180 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "DELETE /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 204 len: 0 microversion: 2.1 time: 0.214678 Jun 24 23:50:31.400624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 131/297] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:50:31 2022] DELETE /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:50:31.414865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:31.415992 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:31.425186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.425647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.426424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:31.426866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:31.502123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:31.510202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5e30519e-7114-487b-a98b-992285ed3f7c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.275422 Jun 24 23:50:31.514857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 167/298] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:31 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:31.777735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:31.787088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0cfdd3c2-0750-4cbd-95f4-225890913a23 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1469 microversion: 2.1 time: 0.377248 Jun 24 23:50:31.792737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 132/299] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:31 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:32.528554 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:32.529795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:32.536870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:32.537620 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:32.538647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:32.539082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:32.707020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:32.717025 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d900cc25-968a-469b-8938-0afa3ad0158b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.193349 Jun 24 23:50:32.717930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 168/300] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:32 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:32.803971 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:32.804776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:32.816318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:32.817036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:32.818112 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:32.818765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:33.059171 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:33.071554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e80efdce-f89e-4a9e-9947-65f20acf502f tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1469 microversion: 2.1 time: 0.271328 Jun 24 23:50:33.073204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 133/301] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:32 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:33.737644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:33.740151 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:33.748795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:33.750173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:33.752665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:33.753368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:34.089756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:34.090963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:34.109141 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:34.109745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:34.111016 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:34.112790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:34.329602 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:34.342147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2c0b2af0-8230-4027-86e2-11c8b06f0434 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.608954 Jun 24 23:50:34.342147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 169/302] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:33 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:34.377127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-b2821922-8269-4c92-ac3a-076f09943a0a req-bd4e6779-1483-4e06-9846-56bcf0f1a3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1", "name": "network-vif-deleted", "tag": "55dc9d6d-8f22-4908-a0a9-33b07aec4d87"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:34.379256 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:34.393445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-b2821922-8269-4c92-ac3a-076f09943a0a req-bd4e6779-1483-4e06-9846-56bcf0f1a3f8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:34.395237 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d75da20a-c891-4c8c-8da6-b3005568b65c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1427 microversion: 2.1 time: 0.309351 Jun 24 23:50:34.397270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 134/303] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:34 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1427 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:34.398873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-b2821922-8269-4c92-ac3a-076f09943a0a req-bd4e6779-1483-4e06-9846-56bcf0f1a3f8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:34.429817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-b2821922-8269-4c92-ac3a-076f09943a0a req-bd4e6779-1483-4e06-9846-56bcf0f1a3f8 service nova] Creating event network-vif-deleted:55dc9d6d-8f22-4908-a0a9-33b07aec4d87 for instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 on hv-cinder-84762 Jun 24 23:50:34.453154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-b2821922-8269-4c92-ac3a-076f09943a0a req-bd4e6779-1483-4e06-9846-56bcf0f1a3f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079681 Jun 24 23:50:34.455879 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 170/304] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:50:35.358288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:35.358838 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:35.371137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:35.371627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:35.372426 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:35.372923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:35.419327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:35.420086 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:35.436438 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:35.438185 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:35.441127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:35.441601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:35.519227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:35.528370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:35.536626 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lazy-loading 'fault' on Instance uuid 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:50:35.670181 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:35.679128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bda6cdf7-e173-4482-9ba9-9fed287291ca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.325167 Jun 24 23:50:35.679706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 135/305] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:35 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:35.679956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac07e1b2de6f4607a37047b6edee4704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b87adb66004fb39c8558287d1bee98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:35.693567 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a403e5e7-53eb-4c3e-98bd-504bf7cd230c tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 200 len: 1303 microversion: 2.1 time: 0.283122 Jun 24 23:50:35.700427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 171/306] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:35 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:36.702583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:36.703194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:36.710234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:36.710748 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] [instance: 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:36.719649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:36.720288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:36.721193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:36.724683 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:36.731015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:36.731766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:36.732613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:36.733062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:36.769778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] HTTP exception thrown: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Request method failure captured: Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 HTTP/1.1 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk2zICZDBeiTz5czAursUbaYGZFP0TyvbEqWzmHIW-QEayK6Py1EqeIUWPRmUJBa2XoOsK-0UXVQoQ4Wlwe7LYrGwMLjjTXR8IxbzfJY1fyleRGntpb7CuAFgG0NqHPLoU7rfT4OjIXLWfc_9NwSdfasgslaLk38NJe-qw3qp6tCbWU Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 07b87adb66004fb39c8558287d1bee98 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesNegativeTest-68757758 Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:50:36.777455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/07b87adb66004fb39c8558287d1bee98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/07b87adb66004fb39c8558287d1bee98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_07b87adb66004fb39c8558287d1bee98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/07b87adb66004fb39c8558287d1bee98"}]}] Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesNegativeTest-68757758 Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 07b87adb66004fb39c8558287d1bee98 Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesNegativeTest-68757758 Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesNegativeTest-68757758-project Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: ac07e1b2de6f4607a37047b6edee4704 Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesNegativeTest-68757758-project Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. Jun 24 23:50:36.778665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1'} Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:50:36.779332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. Jun 24 23:50:36.780470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:50:36.782779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] Returning 404 to user: Instance 23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:50:36.782779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b924bb2f-a490-4c4d-b299-0348a7343d00 tempest-VolumesNegativeTest-68757758 tempest-VolumesNegativeTest-68757758-project] 10.222.0.47 "GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1" status: 404 len: 111 microversion: 2.1 time: 0.072593 Jun 24 23:50:36.782779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 172/307] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:36 2022] GET /compute/v2.1/servers/23be1bc9-1185-4ee6-9fc5-a56a45e5f8a1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:50:37.064195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:37.073802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4b2d9568-dbb4-4efe-a792-e754cb1f00c9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.379036 Jun 24 23:50:37.087103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 136/308] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:36 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:38.091906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:38.092473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:38.105152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:38.106019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:38.107091 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:38.107785 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:38.351950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:38.360228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a4517950-6fb4-4ac3-9972-3f78b01a602b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.272735 Jun 24 23:50:38.360971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 173/309] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:38 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:39.378331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:39.382666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:39.407377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:39.408034 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:39.412339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:39.412920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:39.421834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-de64f68d-ea5b-4403-b82d-2eae6564053c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Action: 'create', calling method: .version_select at 0x7f7a55f5c790>, body: {"keypair": {"name": "tempest-TestShelveInstance-890809988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxxHPXoHKzXvPwx7GKdXUWO8DhlzwDcs57esUxpCpB0f/JH+y8Bc2k33CbGn8m7RbwLbk19BpYPrO3q+XtLwp2Ktx5BZeeooMRhCR9G6/WGn6w3dclAxHJmzLNnoiAGIQ=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:39.436926 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-de64f68d-ea5b-4403-b82d-2eae6564053c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Getting quotas for project e318cfdc9de345148828c09515cecdc1. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:50:39.441028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-de64f68d-ea5b-4403-b82d-2eae6564053c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Getting quotas for user 7faba3540b1b4ef5a533ab0ff8e1cca3 and project e318cfdc9de345148828c09515cecdc1. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:50:39.491325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-de64f68d-ea5b-4403-b82d-2eae6564053c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.281039 Jun 24 23:50:39.491931 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 137/310] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:50:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:39.596286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:39.605812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8c4a349d-e2a2-4b0b-8bb3-e0a96c7d3f27 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.231405 Jun 24 23:50:39.606728 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 174/311] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:39 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:40.624516 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:40.625236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:40.627519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:40.633944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:40.634390 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:40.635148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:40.635665 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:40.772868 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:40.780606 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f6af4a77-566e-49b1-8629-91c38e7e9fa1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.160447 Jun 24 23:50:40.781163 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 138/312] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:40 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:41.798118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:41.798627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:41.804535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:41.805002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:41.805757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:41.806182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:41.947043 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:41.957808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a7dd9917-03d8-4a00-b58a-1ee66a046fdd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.163529 Jun 24 23:50:41.962019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 175/313] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:41 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:42.976999 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:42.977615 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:42.984758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:42.985213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:42.985977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:42.986412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:43.129378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:43.136782 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-79918ab5-d89b-44cc-9a92-95a91fed3ea0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.163548 Jun 24 23:50:43.137512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 139/314] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:42 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:44.153968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:44.156393 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:44.164100 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:44.164854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:44.166430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:44.167010 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:44.196258 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:44.396420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:44.405892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e1505566-3989-409a-9794-95ca2d2cfdf6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.256155 Jun 24 23:50:44.406747 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 176/315] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:44 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:45.423169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:45.423783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:45.430397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:45.430847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:45.432145 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:45.432614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:45.582012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:45.589554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9e28916a-802a-449d-94e8-2647694652c3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.169895 Jun 24 23:50:45.590212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 140/316] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:45 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:46.607533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:46.608268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:46.614768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:46.615205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:46.615973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:46.616405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:46.751195 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:46.759967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5d191c0b-315c-442d-907a-1c68107efc67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.155884 Jun 24 23:50:46.760924 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 177/317] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:46 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:47.777674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:47.778293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:47.785057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:47.785617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:47.786505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:47.787014 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:47.930926 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:47.939424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-da48f222-9ba9-40a2-bab9-9c2b6370c1d8 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.165802 Jun 24 23:50:47.940076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 141/318] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:47 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:48.958392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:48.959041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:48.966659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:48.967117 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:48.968110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:48.968556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:49.108898 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:49.116978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6f7abab5-3ac1-46d9-a04c-1f2274093f71 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.162278 Jun 24 23:50:49.121489 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 178/319] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:48 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:49.437915 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:49.438447 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:49.444925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:49.445373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:49.446132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:49.446563 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:49.460343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:49.470714 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-833e6a38-70b5-469d-ac08-52dbdbb5c66d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/ips" status: 200 len: 144 microversion: 2.1 time: 0.037549 Jun 24 23:50:49.471274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 142/320] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:50:49 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:50.133874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:50.135631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:50.142549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:50.142998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:50.143766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:50.144199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:50.279488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:50.287015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d528bdc7-d382-4c66-9dc6-f74e1c0e916c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.157139 Jun 24 23:50:50.287568 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 179/321] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:50 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:50.359676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cae1bc33-eb4a-45c9-81fa-7aab949c63df", "device": "/dev/sdb"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:50.361361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:50.367341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:50.367785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:50.368551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:50.369540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:50.668828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cbd611d0-0464-4393-be7b-966bb8837931 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "POST /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313066 Jun 24 23:50:50.669592 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 143/322] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:50:50 2022] POST /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:51.303985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:51.304543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:51.311346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:51.311800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:51.312573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:51.313035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:51.440659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:51.449407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9cf862c6-deee-415b-a52e-ca52c28658c5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.149801 Jun 24 23:50:51.449971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 180/323] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:51 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:51.453222 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:51.453814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:51.459898 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:51.460341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:51.461127 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:51.461568 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:51.488243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-450faa2d-eacd-459e-b53c-14d84306aa90 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/ips" status: 200 len: 152 microversion: 2.20 time: 0.039769 Jun 24 23:50:51.488854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 144/324] 10.222.0.47 () {60 vars in 1288 bytes} [Fri Jun 24 23:50:51 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:50:52.466695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:52.467289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:52.473278 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:52.473723 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:52.474475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:52.474907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:52.600198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:52.608265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6bb33aac-7e8c-4db8-88c2-5485e5b3fe89 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.146007 Jun 24 23:50:52.609039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 181/325] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:52 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:53.625625 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:53.626266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:53.632674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:53.633130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:53.633887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:53.634935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:53.765968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:53.773577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2b58cd53-7f9a-4f8f-8866-f82e670f5151 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.151842 Jun 24 23:50:53.774139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 145/326] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:53 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:54.789645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:54.790338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:54.797370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:54.797812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:54.798564 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:54.798995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:54.956293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:54.966454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4aeffff8-f0ee-4aed-a98d-ff67a08dd07d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.180532 Jun 24 23:50:54.976630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 182/327] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:54 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:55.983938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:55.984551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:55.990947 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:55.991397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:55.992158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:55.992615 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.132362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:56.134741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:50:56.142393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-34e7cf91-592b-414b-b8c0-5cfb2bf92fbf tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.162799 Jun 24 23:50:56.142956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 146/328] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:55 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:56.267441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e63dad11-87a9-4f91-a711-bd619b333b8c"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:56.268736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:56.275065 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.275588 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.276348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.276817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.485441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:50:56.485892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:56.492769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.492999 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.493766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.494377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.520229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lazy-loading 'flavor' on Instance uuid cb534158-a606-4d20-89de-2c7c5cbfa9a7 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:50:56.805933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f943c959-5ada-4a2c-aae6-213a1b9d618b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/action" status: 202 len: 0 microversion: 2.20 time: 0.325927 Jun 24 23:50:56.808741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 147/329] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Jun 24 23:50:56 2022] POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 23:50:56.815038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:56.815731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:56.822097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.822551 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.823472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:56.823916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:56.954364 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:56.962356 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:56.963864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:56.965047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d37d6bf1-fea7-4cc4-a57d-10b61827d520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.154080 Jun 24 23:50:56.965592 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 148/330] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:50:56 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:50:57.160455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:57.161331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:57.171449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:57.171449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:57.171449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:57.171449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:57.318251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:57.329015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-68ab3ce0-84c8-4fd7-bad7-a26a4db046eb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.172769 Jun 24 23:50:57.329883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 149/331] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:57 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:50:57.473812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0c80b0b3-bfc2-45f7-9697-2f1baa31dbed tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.211380 Jun 24 23:50:57.478911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 183/332] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:50:56 2022] POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:50:57.984974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:57.985764 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:57.995883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:57.997030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:57.999102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:57.999766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:58.157792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:58.166682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:58.171533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:58.172836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e8d9e5e0-fdb8-4e89-a64a-1a807dd622e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.192385 Jun 24 23:50:58.177190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 150/333] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:50:57 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:50:58.347199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:58.347888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:58.354068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:58.354534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:58.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:58.355708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:58.498918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:58.506381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0be89871-185e-465e-8ca7-4389b05d8a4a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.163845 Jun 24 23:50:58.506932 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 184/334] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:58 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:50:59.196892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:59.197492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:59.204162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:59.204610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:59.205380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:59.205908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:59.333305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:59.342001 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:59.343726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:59.345054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7ee1bc95-814d-4b6d-a1ef-6ad43a605501 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.152062 Jun 24 23:50:59.346950 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 151/335] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:50:59 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:50:59.523484 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:50:59.524031 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:50:59.531407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:59.531850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:59.532633 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:50:59.533063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:50:59.670184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:50:59.678074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9dfde4cf-221d-4485-b28a-9feae4dc7a0f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.158718 Jun 24 23:50:59.678627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 185/336] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:50:59 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:00.362744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:00.363346 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:00.369756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.370205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.370953 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.371383 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.529545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:00.537747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:00.539474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:00.540863 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-be2f92ee-a633-4384-823b-a19e7bbbc5f2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.181830 Jun 24 23:51:00.541486 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 152/337] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:00 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:00.695014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:00.695630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:00.702030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.702481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.703248 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.703683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.845340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:00.853012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8a514a5b-aef3-4c3b-8377-b581dcfd3f67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1501 microversion: 2.1 time: 0.161655 Jun 24 23:51:00.853880 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 186/338] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:00 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:00.871604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a50095a-986f-42e2-a242-4cccdb9da2b8"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:00.872975 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:00.879287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.879734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.880668 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.881107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.908804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] HTTP exception thrown: Cannot 'attach_volume' instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde while it is in vm_state rescued Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Request method failure captured: Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/os-volume_attachments HTTP/1.1 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 74 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1cBwVNNAxzE76WSZ8Z5p_LLGlX35aLEOjd_VyWHbkJiifV0IDEEgVkGvKSSQxP0JG63sFpYFnpscPv3x-NCeF5U4Rxs6iWTIElzw7WhF4qXW-Dh_TiZCRupUIRCRz_IIRhQuZqTHn5KIp0cMPM7pBr19m2AP0RUpt7rv7TP66P5FE Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:51:00.910734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}] Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 5eb7e8b4befd4d519b440c632b59e724 Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {"volumeAttachment": {"volumeId": "1a50095a-986f-42e2-a242-4cccdb9da2b8"}} Jun 24 23:51:00.912302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Cannot 'attach_volume' instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde while it is in vm_state rescued Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'server_id': 'ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde', 'body': {'volumeAttachment': {'volumeId': '1a50095a-986f-42e2-a242-4cccdb9da2b8'}}} Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:51:00.913294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde while it is in vm_state rescued Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:51:00.914511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde while it is in vm_state rescued Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Returning 409 to user: Cannot 'attach_volume' instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde while it is in vm_state rescued {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b5b14bfb-e278-43f5-b70c-fb94e3516326 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044772 Jun 24 23:51:00.915584 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 153/339] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:51:00 2022] POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 23:51:00.921671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:00.922312 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:00.928615 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.929061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:00.929901 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:00.930624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:01.004009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dcbf6658-01aa-43a1-87c7-066680be7fe2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/action" status: 202 len: 0 microversion: 2.1 time: 0.086351 Jun 24 23:51:01.007844 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 187/340] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:51:00 2022] POST /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:51:01.017761 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:01.018559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:01.026491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:01.027366 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:01.029160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:01.029805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:01.254541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:01.262251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3c8be6a0-4165-4456-9461-300cf5a0cb67 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.250034 Jun 24 23:51:01.263433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 154/341] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:01 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:01.561659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:01.563210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:01.570091 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=43 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:01.572662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:01.573336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:01.574297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:01.574746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:01.730560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:01.741111 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:01.743002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:01.744177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-04b648fd-40a6-4353-a4e6-1dbfcc1d65e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.188299 Jun 24 23:51:01.744758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 188/342] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:01 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:02.281164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:02.281711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:02.288216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:02.288697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:02.289470 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:02.289904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:02.420493 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:02.428005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-662c3d8c-8a86-467e-9b7b-6cc445a0a72e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.152052 Jun 24 23:51:02.428550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 155/343] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:02 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:02.764326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:02.765177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:02.771969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:02.772418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:02.773273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:02.773719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:02.907271 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:02.915128 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:02.916639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:02.917780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-87b1dabf-1a4d-41f0-a0e4-e819e3873344 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.158009 Jun 24 23:51:02.918394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 189/344] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:02 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:03.442553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:03.443120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:03.445631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:03.446241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:03.449603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.450058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:03.450826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.451263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:03.452202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.452681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:03.453441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.453870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:03.472167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:03.477766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-19b1671a-8241-4abb-be25-b204233873f2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/ips" status: 200 len: 150 microversion: 2.1 time: 0.039079 Jun 24 23:51:03.478340 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 156/345] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:51:03 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:03.591487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:03.599957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-193bd5c5-b72e-446f-9a6c-8f88010cc32e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.158017 Jun 24 23:51:03.600840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 190/346] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:03 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:03.935254 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:03.936276 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:03.942274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.942718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:03.943466 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:03.943896 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:04.077246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:04.085042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:04.086567 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:04.087722 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4878d6f1-8a31-4ecc-81b6-b5cd8fa8d230 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.156476 Jun 24 23:51:04.088279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 157/347] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:03 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:04.616974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:04.617591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:04.624542 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:04.625024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:04.625798 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:04.626267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:04.753787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:04.761169 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-37e1daae-7eb1-40d3-80e1-d62b1853c01e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.148009 Jun 24 23:51:04.761726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 191/348] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:04 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:05.106054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:05.106655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:05.113591 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:05.114037 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:05.114787 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:05.115219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:05.239488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:05.247286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:05.249462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:05.250622 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-db8e2b0a-5556-4a0a-908f-a1f42de216dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.148507 Jun 24 23:51:05.251170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 158/349] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:05 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:05.778275 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:05.778886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:05.785407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:05.785852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:05.786611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:05.787043 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:05.960947 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:05.964174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-47234e5a-5473-4ff8-b037-2d278060732d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.189618 Jun 24 23:51:05.966731 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 192/350] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:05 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:06.269569 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:06.270239 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:06.277142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.277714 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:06.278499 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.279021 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:06.415935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:06.424386 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:06.425906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:06.427056 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6904279c-2504-4713-a0f8-cbe54ae6d565 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.161829 Jun 24 23:51:06.427597 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 159/351] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:06 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:06.959861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d87b63bc-4866-4619-b76f-3c3232de0871"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:06.961563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:06.968015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.968459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:06.969286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.969716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:06.983930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:06.984828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:06.992772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.993257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:06.994035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:06.994483 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:07.136087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:07.143936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-330857a9-3532-4ba3-9d3d-e0ead58d6064 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.164537 Jun 24 23:51:07.144497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 160/352] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:06 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:07.444245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:07.444892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:07.451794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:07.452313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:07.453263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:07.453830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:07.582235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:07.590199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:07.592933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:07.594162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-01cc6f8e-94a9-468b-99b5-dd650f3fb19f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.153880 Jun 24 23:51:07.594726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 161/353] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:07 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:08.161039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:08.161658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:08.167580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:08.168035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:08.168840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:08.169281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:08.173960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:08.305081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:08.312613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-84cf8416-08c9-4b82-a0be-1d44e33f3667 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.155315 Jun 24 23:51:08.313150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 162/354] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:08 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:08.612034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:08.612794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:08.619209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:08.619657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:08.620420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:08.620899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:08.747391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:08.755622 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:08.757178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:08.758327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7ddf4313-2543-4b2f-b8ca-8746bf98a2e5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.150954 Jun 24 23:51:08.758875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 163/355] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:08 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:09.329550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:09.330792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:09.336845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:09.337296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:09.338055 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:09.338499 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:09.472857 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:09.480573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-207d2265-fea4-4c6b-b305-debc6678553a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1509 microversion: 2.1 time: 0.154839 Jun 24 23:51:09.481369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 164/356] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:09 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:09.776205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:09.776859 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:09.783574 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:09.784025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:09.784814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:09.785251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:09.917879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:09.927034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:09.928537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:09.929719 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9b71968c-02b7-490f-95b6-272c7061a68a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.157537 Jun 24 23:51:09.930272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 165/357] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:09 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:10.497459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:10.498813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:10.505115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:10.505566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:10.506339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:10.506773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:10.579762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-893fad87-c082-48a5-8546-5b44548650ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.623588 Jun 24 23:51:10.580691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 193/358] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:51:06 2022] POST /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments => generated 194 bytes in 3625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:10.656482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:10.663966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d9dd7391-cb11-4f37-ba5f-94090ed92b41 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1515 microversion: 2.1 time: 0.170387 Jun 24 23:51:10.664516 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 166/359] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:10 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:10.962642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:10.963410 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:10.974031 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:10.974490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:10.975273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:10.975712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:11.157395 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:11.166531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:11.168130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:11.170429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fb232a0b-2ba9-467c-8442-cdb7b4d7ae4e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.224065 Jun 24 23:51:11.182617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 194/360] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:10 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:12.189544 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:12.190410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:12.193561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=58 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:12.199306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:12.199866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:12.201388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:12.202032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:12.331896 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:12.339688 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:12.341244 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:12.342575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5d52fd44-0ccc-4ebe-8a42-ea797ca06dc4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.157215 Jun 24 23:51:12.343152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 167/361] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:12 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:13.361314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:13.361929 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:13.368508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:13.369106 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:13.369775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:13.370211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:13.498064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:13.506019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:13.507529 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:13.508705 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0bcfdd70-5e56-4e04-992a-d5839151bda1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.151974 Jun 24 23:51:13.509259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 195/362] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:13 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:14.529805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:14.530602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:14.539945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:14.540388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:14.541352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:14.541786 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:14.694673 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:14.702661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:14.704189 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:14.705371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-80ba634a-6b81-4d32-bfb8-c0b6e03eaa68 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.181081 Jun 24 23:51:14.705912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 168/363] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:14 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:15.157815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-18f66f00-00dd-4804-8ccd-2d4b209d7132 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: .version_select at 0x7f7a55cc1160>, body: {"keypair": {"name": "tempest-keypair-2039477784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YBBD1doTYYo8NzUOGFdJe29QxBKicJ+0mfCKeYOszzgZdmPeWcT2rua9QJ/b4GRIE3d08ksXdhIrdvgFcGgZxXbIjQYCppfAI6TSz4DbxiW+u3TY8UNBDMAplBsljlA=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:15.172448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-18f66f00-00dd-4804-8ccd-2d4b209d7132 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:15.176343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-18f66f00-00dd-4804-8ccd-2d4b209d7132 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for user 5eb7e8b4befd4d519b440c632b59e724 and project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:15.199176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-18f66f00-00dd-4804-8ccd-2d4b209d7132 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045943 Jun 24 23:51:15.199764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 196/364] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:51:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:15.635055 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-447c6fb6-8968-4eef-b692-57810bc858f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:15.642013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-447c6fb6-8968-4eef-b692-57810bc858f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:15.642475 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-447c6fb6-8968-4eef-b692-57810bc858f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:15.710008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-447c6fb6-8968-4eef-b692-57810bc858f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Going to try to stop instance {{(pid=124093) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 23:51:15.724923 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:15.725713 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:15.731780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:15.732991 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:15.733812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:15.734254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:15.755685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-447c6fb6-8968-4eef-b692-57810bc858f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action" status: 202 len: 0 microversion: 2.1 time: 0.127777 Jun 24 23:51:15.759362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 169/365] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:51:15 2022] POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:51:15.767449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:15.768391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:15.775402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:15.775881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:15.776827 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:15.777293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:15.932038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:15.941377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9c293ba4-054c-4e95-a00b-3c47833630c7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.180001 Jun 24 23:51:15.941956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 170/366] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:15 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:15.971457 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:15.979641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:15.981208 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:15.982869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c385fb2a-3d07-4a76-9ec5-10b6dcd1d84d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.262159 Jun 24 23:51:15.983428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 197/367] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:15 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:16.269566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1593172941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-890809988", "security_groups": [{"name": "tempest-secgroup-smoke-1814505911"}], "networks": [{"uuid": "9824da59-e893-48f6-9990-fd3f93339330"}], "block_device_mapping_v2": [{"uuid": "0fcf7c17-dbda-4e04-b991-351b307c7e17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:16.381432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] validate_networks() for [('9824da59-e893-48f6-9990-fd3f93339330', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:51:16.626089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1022965090", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04d42125-bd03-4d11-9c66-f5357e9049c9"}], "security_groups": [{"name": "tempest-securitygroup--1069238636"}], "key_name": "tempest-keypair-2039477784", "user_data": "}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:16.730762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] validate_networks() for [('04d42125-bd03-4d11-9c66-f5357e9049c9', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:51:16.764717 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:51:16.765197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:51:16.765596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:51:16.765996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:51:16.766397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:51:16.775479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:16.775920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:16.776747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:16.777205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:16.793840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Getting quotas for project e318cfdc9de345148828c09515cecdc1. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:16.798325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Getting quotas for user 7faba3540b1b4ef5a533ab0ff8e1cca3 and project e318cfdc9de345148828c09515cecdc1. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:16.855093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:51:16.857819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fcf7c17-dbda-4e04-b991-351b307c7e17',volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:51:17.005699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-393885f8-cd7f-4ebf-afce-09d4fbcddaf6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739853 Jun 24 23:51:17.006225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 171/368] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:51:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:51:17.012961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:17.014189 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:17.022161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.022910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.023894 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.024363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.135999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:51:17.136425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:51:17.136925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:51:17.137450 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:51:17.138009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:51:17.148204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.148691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.149537 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.151170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.168745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.172012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:17.176388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Getting quotas for user 5eb7e8b4befd4d519b440c632b59e724 and project 7ee4f2aaeed54d0fb16474b971f333d6. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:17.180510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f4167320-7d49-4c65-a957-cc8f37bec532 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.173052 Jun 24 23:51:17.181781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 172/369] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:17 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:17.187198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:17.187792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:17.193865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.194311 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.195104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:17.195527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:17.198005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:51:17.200463 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:51:17.254369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e693d301-2d43-4ebd-9083-d016d864cafe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.633091 Jun 24 23:51:17.259842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 198/370] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:51:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:51:17.260535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-88345839-86af-4b18-aa38-6422ee0c93ee tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:17.261204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-88345839-86af-4b18-aa38-6422ee0c93ee tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:17.345829 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-88345839-86af-4b18-aa38-6422ee0c93ee tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.354134 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-88345839-86af-4b18-aa38-6422ee0c93ee tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1088 microversion: 2.1 time: 0.097776 Jun 24 23:51:17.356003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 199/371] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:17 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:17.364917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.376664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8f21ea01-7504-42d0-82a4-dee0eb8d912d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:17.377641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8f21ea01-7504-42d0-82a4-dee0eb8d912d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:17.382986 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.384924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.386288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7bdf8392-289f-4a2b-ac18-ff19aa1584e8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.203535 Jun 24 23:51:17.387156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 173/372] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:17 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:17.451166 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8f21ea01-7504-42d0-82a4-dee0eb8d912d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:17.458764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8f21ea01-7504-42d0-82a4-dee0eb8d912d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1246 microversion: 2.1 time: 0.101497 Jun 24 23:51:17.459431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 200/373] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:17 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:18.198993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:18.199602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:18.206648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.207098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.207867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.208290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.339311 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.347181 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-83918641-1a27-4805-9552-8524fda43ecc tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.152055 Jun 24 23:51:18.347733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 174/374] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:18 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:18.375977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:18.376642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:18.383626 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.384066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.384845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.385275 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.405979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:18.406585 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:18.413147 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.413595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.414359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.414790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.445758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.454210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-34f6ebed-3d50-4b25-ad3b-2901e4b6564c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1138 microversion: 2.1 time: 0.082999 Jun 24 23:51:18.454863 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 201/375] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:18 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:18.475572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:18.476209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:18.482144 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.482669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.483454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:18.483891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:18.543300 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.550000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.551064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-19f96c50-fb8e-4b1a-8ba5-743eb1ad3227 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1250 microversion: 2.1 time: 0.079292 Jun 24 23:51:18.551624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 202/376] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:18 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:18.560889 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.560889 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:18.561603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6a649d1c-a917-4cc1-b8b8-0d4082c52520 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.159665 Jun 24 23:51:18.562139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 175/377] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:18 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:19.364053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:19.364600 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:19.370560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.371001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.371749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.372174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.471708 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:19.472322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:19.479417 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.480059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.481000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.481443 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.504529 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.512415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f0847c6f-371c-43df-987c-5d52574694f0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.152283 Jun 24 23:51:19.513501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 203/378] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:19 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:19.546463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.554057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7190e13d-d077-4884-a6d7-f6597f48f883 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1186 microversion: 2.1 time: 0.086109 Jun 24 23:51:19.554639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 176/379] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:19 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:19.568159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:19.568797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:19.574710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.575161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.576671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.577119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.581216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:19.581835 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:19.588602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.589072 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.589843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:19.590280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:19.640024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.647678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ed9dcc4f-3114-4842-b8f3-e4801090b21d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1298 microversion: 2.1 time: 0.083277 Jun 24 23:51:19.648225 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 204/380] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:19 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:19.723943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.734970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.737399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:19.738851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cc097b10-7aef-460e-bce7-c8ac5712d6ee tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.163469 Jun 24 23:51:19.748675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 177/381] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:19 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:20.531570 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:20.532191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:20.538780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.539226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.539994 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.540407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.570682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:20.571474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:20.580619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.581599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.582533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.582965 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.600052 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:20.654278 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.662542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9e24c3db-1e13-4feb-8760-f089663ab133 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1204 microversion: 2.1 time: 0.096238 Jun 24 23:51:20.663105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 178/382] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:20 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:20.667598 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:20.668261 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:20.674679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.675128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.675888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.676319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.680476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.689246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-67034019-5e65-412f-a32f-92561dccc241 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.162626 Jun 24 23:51:20.689810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 205/383] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:20 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:20.738836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.746129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-af9bac61-d7d3-4ba4-aef5-999bb1312edb tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1304 microversion: 2.1 time: 0.082099 Jun 24 23:51:20.746686 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 179/384] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:20 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:20.758436 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:20.759039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:20.765263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.765735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.766491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.766922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.912442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.916470 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:20.916996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:20.922087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.923586 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:20.924549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.924915 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-29943cc3-0d53-4edf-9b81-96fecef4a35f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1745 microversion: 2.20 time: 0.170227 Jun 24 23:51:20.925027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:20.925478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 206/385] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:20 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:20.926054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:20.926496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.057231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lazy-loading 'services' on Instance uuid 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:51:21.177629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2a641c28-fc9c-4eda-a62f-2c85994de165 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16/os-volume_attachments/cae1bc33-eb4a-45c9-81fa-7aab949c63df" status: 202 len: 0 microversion: 2.1 time: 0.264997 Jun 24 23:51:21.179268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 180/386] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:51:20 2022] DELETE /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16/os-volume_attachments/cae1bc33-eb4a-45c9-81fa-7aab949c63df => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:51:21.680949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:21.681629 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:21.688422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.688900 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.689665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.690094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.708856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:21.709354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:21.721162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.721631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.727867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.728324 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.895466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:21.910237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2ac71ac3-31c3-42f3-9227-65f47138688a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1272 microversion: 2.1 time: 0.233537 Jun 24 23:51:21.910836 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 207/387] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:21 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:21.915442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:21.916039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:21.939250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.940063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:21.941060 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:21.941719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:22.129856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:22.140244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-58d57040-4624-429d-8169-72d2483cf400 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.228354 Jun 24 23:51:22.140914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 208/388] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:21 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:22.147381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:22.148215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:22.153792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:22.155269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:22.155877 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:22.157010 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:22.157589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:22.162808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7fa1c52f-356b-49de-815f-4413bd5d4430 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.459143 Jun 24 23:51:22.163457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 181/389] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:21 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:22.184257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:22.328599 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:22.337645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:22.339154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:22.340366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-426a42fe-6b90-42ec-8a22-2ae544a17918 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1745 microversion: 2.20 time: 0.196968 Jun 24 23:51:22.341452 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 209/390] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:22 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:22.379077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2b4dd6e4-b3d1-46d4-98a6-827a1b5d3097 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: .version_select at 0x7f7a55bbf700>, body: {"keypair": {"name": "tempest-keypair-1438065276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDwInN25cHcFL7lvugT+RjYWt96OxfqZizTO7b5a7J+8/Y6lrVbwLzigVrep7fFlLu0tZFcsULwMszst/uTlQh7OLrYJLUPeILRjXAA+W0iO4I/OFPGDMDI+wyXrz73Hg=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:22.393237 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-2b4dd6e4-b3d1-46d4-98a6-827a1b5d3097 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:22.397286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-2b4dd6e4-b3d1-46d4-98a6-827a1b5d3097 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:22.420748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2b4dd6e4-b3d1-46d4-98a6-827a1b5d3097 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045708 Jun 24 23:51:22.421343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 182/391] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:51:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:22.927152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:22.927847 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:22.937115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:22.937115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:22.937115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:22.937115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.158217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:23.158617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:23.160229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:23.167311 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0e7a9d53-f146-49f8-8ede-90608ecf096c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.243839 Jun 24 23:51:23.177803 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 210/392] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:22 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:23.182458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:23.183110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:23.193232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.195602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.196674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.199431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.206790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.207242 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.208033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.208476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.601309 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:23.615724 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3088fa02-2bd6-41d9-b0ca-894b4c5856b6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.438591 Jun 24 23:51:23.616491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 211/393] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:23 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:23.628906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:23.631035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:23.644470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.645636 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.647769 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.650550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.825601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:23.837841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3e78dcd1-5648-4236-960d-76c0b2fc1d0d tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.683877 Jun 24 23:51:23.851036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 183/394] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:23 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:23.858480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:23.860480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:23.869309 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.870641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.871711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:23.872533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:23.923350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:51:24.007143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.017006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.026197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.027426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-666fb7ee-eb60-4ca4-a37d-d6a1ed66a824 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.409835 Jun 24 23:51:24.027974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 212/395] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:23 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:24.084840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-c5e50177-7917-4709-8cb6-dd43760fe171 req-48e05a07-64e1-49ff-a67e-ac694eb78607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:24.100176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-c5e50177-7917-4709-8cb6-dd43760fe171 req-48e05a07-64e1-49ff-a67e-ac694eb78607 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.100696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-c5e50177-7917-4709-8cb6-dd43760fe171 req-48e05a07-64e1-49ff-a67e-ac694eb78607 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.116202 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-98b46980-4805-4c4a-94cb-f36cf3c96604 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 204 len: 0 microversion: 2.1 time: 0.260097 Jun 24 23:51:24.117043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 184/396] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:51:23 2022] DELETE /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:51:24.128615 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:24.131433 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:24.131780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-c5e50177-7917-4709-8cb6-dd43760fe171 req-48e05a07-64e1-49ff-a67e-ac694eb78607 service nova] Creating event network-changed:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:51:24.145261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-c5e50177-7917-4709-8cb6-dd43760fe171 req-48e05a07-64e1-49ff-a67e-ac694eb78607 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064775 Jun 24 23:51:24.147893 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 213/397] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:24.149091 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.149955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.150953 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.151591 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.186375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:24.187179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:24.199659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.201886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.202878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.204431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.456946 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.474467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-84730e46-8296-4de9-85cb-39e4f6f1eb56 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1514 microversion: 2.1 time: 0.351448 Jun 24 23:51:24.475104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 185/398] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:24 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:24.636555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:24.637485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:24.647957 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.648892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.650076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.650713 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.807492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.819536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b0fc8a37-1f99-40a5-918f-055773be54b0 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.637685 Jun 24 23:51:24.832059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 214/399] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:24 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:24.855181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:24.856405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:24.873103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.879059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.880122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:24.882305 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:24.976333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:24.997696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-83f93bab-7f63-4273-8725-33b9f6c4e84e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.365555 Jun 24 23:51:24.998655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 186/400] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:24 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:25.056414 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:25.057075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:25.073497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.074158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.075380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.076126 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.219132 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:25.230690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2205dd6c-1c22-4928-b6b9-0d5508711649 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.379265 Jun 24 23:51:25.233199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 215/401] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:24 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:25.237940 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-ad8192b9-880f-4420-98bd-a4b233081e09 req-5b4547f1-f685-41fe-b341-071b73500b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "name": "network-vif-plugged", "status": "completed", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:25.273452 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ad8192b9-880f-4420-98bd-a4b233081e09 req-5b4547f1-f685-41fe-b341-071b73500b67 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.274359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ad8192b9-880f-4420-98bd-a4b233081e09 req-5b4547f1-f685-41fe-b341-071b73500b67 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.303038 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-ad8192b9-880f-4420-98bd-a4b233081e09 req-5b4547f1-f685-41fe-b341-071b73500b67 service nova] Creating event network-vif-plugged:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:51:25.308298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-ad8192b9-880f-4420-98bd-a4b233081e09 req-5b4547f1-f685-41fe-b341-071b73500b67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073787 Jun 24 23:51:25.312175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 216/402] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:25.384648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:25.394137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:25.395630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:25.397280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bb383845-ef76-448f-b61e-63212fb7a704 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.345498 Jun 24 23:51:25.398415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 187/403] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:25 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:25.494804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:25.495579 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:25.512177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.515192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.516246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.516787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.815481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:25.824392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bf28a668-4045-40f0-b93c-aad9e9ac6907 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1514 microversion: 2.1 time: 0.334388 Jun 24 23:51:25.828951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 217/404] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:25 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:25.847789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:25.848758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:25.858444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.859012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:25.860307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:25.861595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.017432 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:26.018466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:26.029544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.044392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.044392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.047202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.532970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:26.542458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-11e0c6a1-3b3b-40cd-8e79-46988c577b63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.704993 Jun 24 23:51:26.543806 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 188/405] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:25 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:26.550682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:26.551589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:26.565655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:26.578160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7e0ee434-d046-4152-8f18-285aa8d516e8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.566870 Jun 24 23:51:26.580038 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 218/406] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:26 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:26.585772 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-2b78e4a3-5a5d-4dab-8024-62acc4cd7423 req-6e38ed19-7193-4bb9-be90-3431894d84d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:26.588219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.588781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.590127 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.596828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.610967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-2b78e4a3-5a5d-4dab-8024-62acc4cd7423 req-6e38ed19-7193-4bb9-be90-3431894d84d2 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.619390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-2b78e4a3-5a5d-4dab-8024-62acc4cd7423 req-6e38ed19-7193-4bb9-be90-3431894d84d2 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.641280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-2b78e4a3-5a5d-4dab-8024-62acc4cd7423 req-6e38ed19-7193-4bb9-be90-3431894d84d2 service nova] Creating event network-changed:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:51:26.646787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-2b78e4a3-5a5d-4dab-8024-62acc4cd7423 req-6e38ed19-7193-4bb9-be90-3431894d84d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064158 Jun 24 23:51:26.647384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 219/407] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:26.652983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:26.654009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:26.662003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.662480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.663715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:26.664190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:26.785249 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:26.896036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:26.907512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:26.911264 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:26.912976 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3c2df28c-72d9-4bfc-a323-0c0116373491 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.264384 Jun 24 23:51:26.914538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 220/408] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:26 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:26.921404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-439483382", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b11b39b-22df-4ca5-82fe-6b58b236b565"}], "security_groups": [{"name": "tempest-securitygroup--500379639"}], "key_name": "tempest-keypair-1438065276", "user_data": "}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:27.163468 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:27.177387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] validate_networks() for [('3b11b39b-22df-4ca5-82fe-6b58b236b565', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:51:27.185100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:27.198901 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a0386739-46dd-43c1-8f4d-e8b955b0ca64 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.652429 Jun 24 23:51:27.217167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 189/409] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:26 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:27.230531 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:27.233904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:27.242277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.242955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.243968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.244569 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.416105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:27.439339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-566438e0-6493-4c52-ab4c-8aaacdb720f1 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 200 len: 1472 microversion: 2.1 time: 0.218050 Jun 24 23:51:27.442558 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 190/410] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:27 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:27.455442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-d9d5d605-3c3a-4b62-b4f5-cfa0df78478e req-1d9e4f2e-ec64-4314-8cb2-253c0c20efd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0d0fd-71fd-43de-91fd-5baa71d19f16", "name": "network-vif-deleted", "tag": "4b56b985-63bb-4183-8814-6013082f135a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:27.456039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=14 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:27.496368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-d9d5d605-3c3a-4b62-b4f5-cfa0df78478e req-1d9e4f2e-ec64-4314-8cb2-253c0c20efd0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.497348 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-d9d5d605-3c3a-4b62-b4f5-cfa0df78478e req-1d9e4f2e-ec64-4314-8cb2-253c0c20efd0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.535217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-d9d5d605-3c3a-4b62-b4f5-cfa0df78478e req-1d9e4f2e-ec64-4314-8cb2-253c0c20efd0 service nova] Creating event network-vif-deleted:4b56b985-63bb-4183-8814-6013082f135a for instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 on hv-cinder-84762 Jun 24 23:51:27.547897 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-d9d5d605-3c3a-4b62-b4f5-cfa0df78478e req-1d9e4f2e-ec64-4314-8cb2-253c0c20efd0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100163 Jun 24 23:51:27.548494 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 191/411] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:27.563467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:27.564170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:27.573432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.573872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.579456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.580079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.801216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:27.809812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b9e6fec3-8b4b-4368-ae3b-26ad2fcbe2fd tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.253731 Jun 24 23:51:27.812295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 192/412] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:27 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:27.833722 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:27.835580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:27.847454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:51:27.847981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:51:27.848436 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:51:27.848867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:51:27.849278 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:51:27.851205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:27.864319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.867067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.868308 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.869130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.871389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.873159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.874777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:27.875960 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:27.943509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:27.957797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:27.979912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:51:27.982759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:51:28.069889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ad38a4af-0346-4316-ac8a-03ee04e1db5c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.153595 Jun 24 23:51:28.071288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 221/413] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:51:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:51:28.076862 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:28.077740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:28.085631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.086298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.087315 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.087934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.511592 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.520724 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.522712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.523928 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-31a19574-e36f-4f03-8523-cdcab07677fe tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.451539 Jun 24 23:51:28.524470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 222/414] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:28 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:28.529368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8c9d0acc-5779-46b2-a112-9a7d22abd6e6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:28.530172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8c9d0acc-5779-46b2-a112-9a7d22abd6e6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:28.547134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.557600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-685ac26d-11f6-4926-8529-2e6607b01566 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.743727 Jun 24 23:51:28.558456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 193/415] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:27 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:28.564070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:28.565247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:28.572974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.573727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.574800 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.575602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.600829 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8c9d0acc-5779-46b2-a112-9a7d22abd6e6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.608822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8c9d0acc-5779-46b2-a112-9a7d22abd6e6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1241 microversion: 2.1 time: 0.083045 Jun 24 23:51:28.609378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 223/416] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:28 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:28.619010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:28.623533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:28.624175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 5ff0d0fd-71fd-43de-91fd-5baa71d19f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:28.631882 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.632564 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.633617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.634262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.670492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] HTTP exception thrown: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Request method failure captured: Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 HTTP/1.1 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk2vHh_3zP-JoopJoSlNnK9af-qO13MF2YVaeNtV4-91xuWq0piNLzkDNoAYFs480MMP05KouNHWykEStPCt9LxCB1HWUskJu-ch6j3RCUgCUWDPxN6PRTGN88HvMjjnS9kYIS8szD7ThVXpyyBtBE2b916XoHIcUO0knS3fFbDcfAE Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: b45f691b51284dbbb7f1fd8d482af7e4 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:51:28.672845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b45f691b51284dbbb7f1fd8d482af7e4"}]}] Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: b45f691b51284dbbb7f1fd8d482af7e4 Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesSnapshotTestJSON-741748695-project Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 6e416196a4614ccc90c8f2411e3f0258 Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesSnapshotTestJSON-741748695-project Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. Jun 24 23:51:28.674521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '5ff0d0fd-71fd-43de-91fd-5baa71d19f16'} Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:51:28.675462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. Jun 24 23:51:28.677011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:51:28.679297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Returning 404 to user: Instance 5ff0d0fd-71fd-43de-91fd-5baa71d19f16 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:51:28.680479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-77f5a830-3b4f-4c37-94f9-f7fe8acd6735 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16" status: 404 len: 111 microversion: 2.1 time: 0.070019 Jun 24 23:51:28.681558 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 224/417] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:28 2022] GET /compute/v2.1/servers/5ff0d0fd-71fd-43de-91fd-5baa71d19f16 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:51:28.796537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:28.806527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2744901e-f522-4322-abb2-e6ac3e04a465 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.246662 Jun 24 23:51:28.816943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 194/418] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:28 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:28.830273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:28.830800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:28.839081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.839768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:28.841422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:28.846181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.035606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.046287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1894f56d-8587-4073-a773-1c189adf7713 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.222607 Jun 24 23:51:29.046967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 225/419] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:28 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:29.543652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:29.545172 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:29.552177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.553389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.554371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.555005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.580543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:29.581377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:29.594051 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.595472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.596323 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.598619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.780863 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.782026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.790512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.792356 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.793795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d2a116a4-9826-467c-b242-93726b875a29 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.254765 Jun 24 23:51:29.793923 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-821c52a2-0bbb-4fa9-8195-586d76c4005b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.220600 Jun 24 23:51:29.795114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 195/420] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:29 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:29.800140 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:29.801537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:29.805369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 226/421] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:29 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:29.809283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.810786 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.811750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.812363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.824280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:29.824922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:29.832340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.833358 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.835108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:29.835543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:29.888682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:29.898135 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-99be1e61-5cb5-4859-9101-1d58258ffe3b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1245 microversion: 2.1 time: 0.101433 Jun 24 23:51:29.899108 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 196/422] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:29 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:29.998832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:30.006925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-903d9e3c-a3d7-4025-9e40-ef6ba50816e1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.186486 Jun 24 23:51:30.007573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 227/423] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:29 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:30.063640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:30.064283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:30.070457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.071336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:30.071891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.072500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:30.230559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:30.239079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6b49bf15-9c24-4274-8a0e-402cfe7e56bb tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.179762 Jun 24 23:51:30.239943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 197/424] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:30 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:30.816396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:30.818262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:30.822717 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:30.830222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.830927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:30.831950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.832652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:30.833783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:30.843929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.844682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:30.845616 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:30.846231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.003505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.015830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-facd05b3-1cd0-4e69-83ee-49af74e41d31 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.196954 Jun 24 23:51:31.025653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 198/425] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:30 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:31.030304 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:31.031466 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:31.040178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.041706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.042736 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.043391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.100763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.110310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.111831 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.113605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-16dc81b1-f1d1-4563-b5e0-08ecb925bbac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.301806 Jun 24 23:51:31.114659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 228/426] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:30 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:31.119627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:31.120421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:31.122947 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.127936 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.128606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.129744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.130342 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.132316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d319679f-d159-4f54-87ca-b13698c75e53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1245 microversion: 2.1 time: 0.114316 Jun 24 23:51:31.133218 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 199/427] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:31 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:31.258069 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:31.259108 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:31.267933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.268840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.269821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:31.270513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:31.301777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.313040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-010231d2-67e6-4a24-aacf-1ac122c52bc0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.196995 Jun 24 23:51:31.314143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 229/428] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:31 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:31.423630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:31.432955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d131d39e-2e9c-403b-8e2c-fe075ba588ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.178602 Jun 24 23:51:31.434111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 200/429] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:31 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:32.035061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:32.036495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:32.045434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.045901 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.046805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.047407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.078706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:32.144657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:32.144657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:32.159041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:32.217987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.217987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.241328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.242096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.404820 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=10 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:32.446269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.461958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bc003efe-849c-4392-a6c0-395935dfaa5f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.431616 Jun 24 23:51:32.465206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 230/430] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:32 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:32.471315 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:32.472445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:32.478975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.479860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.480939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.482190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.571363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.583486 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4d72c162-f8fc-46ec-85c2-4c19a9a201c0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1237 microversion: 2.1 time: 0.116239 Jun 24 23:51:32.584356 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 231/431] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:32 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:32.589544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:32.590977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:32.603719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.607324 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.610508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.611372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.628555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.646855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.653899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.656139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-96223b23-c766-4291-8456-62ba340bf22c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.521884 Jun 24 23:51:32.657297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 201/432] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:32 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:32.672522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:32.673453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:32.685198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.689314 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.690375 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:32.692250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:32.842282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.850657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7f33b51b-38fb-4cef-aa55-a2525cccfa7f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.264976 Jun 24 23:51:32.852478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 232/433] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:32 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:32.912260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:32.922053 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ba6096bd-bf11-4b3b-9880-87ba7df16088 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.263027 Jun 24 23:51:32.931961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 202/434] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:32 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:33.472038 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-d2002f9b-efb9-4932-9338-086a5ec97876 req-2202e52f-73a3-46a2-922a-5d41c0cd41c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "name": "network-vif-plugged", "status": "completed", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:33.482478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:33.482977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:33.485785 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d2002f9b-efb9-4932-9338-086a5ec97876 req-2202e52f-73a3-46a2-922a-5d41c0cd41c8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.486510 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d2002f9b-efb9-4932-9338-086a5ec97876 req-2202e52f-73a3-46a2-922a-5d41c0cd41c8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.494394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.494898 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.495713 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.496151 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.501939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-d2002f9b-efb9-4932-9338-086a5ec97876 req-2202e52f-73a3-46a2-922a-5d41c0cd41c8 service nova] Creating event network-vif-plugged:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:51:33.507328 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-d2002f9b-efb9-4932-9338-086a5ec97876 req-2202e52f-73a3-46a2-922a-5d41c0cd41c8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043307 Jun 24 23:51:33.508535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 233/435] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:33.602739 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:33.605356 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:33.619443 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.619897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.620711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.621154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.749156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:33.761240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7862c46d-0296-46ff-8d5c-136ad0ebba65 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.283803 Jun 24 23:51:33.765688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:33.773159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 203/436] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:33 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:33.779762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:33.780443 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:33.781986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e6578650-d69d-464f-96ae-cd1ad332c948 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1301 microversion: 2.1 time: 0.177947 Jun 24 23:51:33.783207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 234/437] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:33 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1301 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:33.788429 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.789224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.790035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.790552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.869674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:33.870508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:33.898207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.898581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:33.903014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:33.903667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.162473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.174441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8bbaf30f-b7aa-4adc-903b-74e99688f6e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.307100 Jun 24 23:51:34.175198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 235/438] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:33 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:34.192563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:34.193727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:34.207359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.210120 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.218015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.219127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.295784 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.309587 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.312055 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.313854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-003d487e-8d3b-444a-9694-fe004bb9d0b7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.539274 Jun 24 23:51:34.314883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 204/439] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:33 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:34.462718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.472104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9b4662a2-5977-4dea-a709-93aa55eff49e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.295054 Jun 24 23:51:34.483661 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 236/440] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:34 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:34.785998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:34.788821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:34.800353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:34.801239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:34.808851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.819159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.821124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.822146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.824254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.825152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.829553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:34.830199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:34.932539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:34.942282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3f719bd9-7e5b-4d98-af83-4a067ecdaa35 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1299 microversion: 2.1 time: 0.145661 Jun 24 23:51:34.943525 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 237/441] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:34 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:35.089698 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.100397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-01b88087-5963-4fa9-8148-23402ebfc12e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.325369 Jun 24 23:51:35.123140 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 205/442] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:34 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:35.192269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:35.192909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:35.199657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.200960 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.202212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.202927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.333177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:35.334108 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:35.348635 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.349508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.350722 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.351158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.364164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.373485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a412e77b-6bda-4b7b-9009-62c6ad1073aa tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.185999 Jun 24 23:51:35.377337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 238/443] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:35 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:35.494132 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:35.495448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:35.506376 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.507345 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.508965 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.510923 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:35.541675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.564204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.565875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.569036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a06b0cca-8e61-4537-9472-aba0a1c3eaa0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.240085 Jun 24 23:51:35.571209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 206/444] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:35 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:35.704522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:35.718909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b6a4091e-d262-407d-92b2-8c8650a20876 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.231433 Jun 24 23:51:35.729526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 239/445] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:35 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:35.982562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:35.984456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:35.993540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:35.999259 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.000110 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.000980 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.104352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.115075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-90af1cfa-caad-46db-8143-c5499534f01e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1299 microversion: 2.1 time: 0.156176 Jun 24 23:51:36.118931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:36.120495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:36.126599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 207/446] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:35 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:36.127570 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.128013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.128907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.129497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.326999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.335821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8da0350e-986c-48d3-900b-b995ab6d62fa tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.222214 Jun 24 23:51:36.336949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 240/447] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:36 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:36.391293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:36.392186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:36.400367 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.401219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.402337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.403623 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.575051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.590102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:36.592331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:36.599535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f1c43896-6c75-4ad0-89f8-61259fce517e tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.209890 Jun 24 23:51:36.602014 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 208/448] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:36 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:36.602413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.603022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.603946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.604717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.740213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:36.741117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:36.750928 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.753664 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.754632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:36.756561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:36.798497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.809189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.811719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:36.814655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7e810f04-5432-4a60-979f-8809649ed946 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.228520 Jun 24 23:51:36.815854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 241/449] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:36 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:37.035774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:37.044934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6210202e-7e7e-45f7-963f-32f3b27824d1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.311019 Jun 24 23:51:37.054762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 209/450] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:36 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:37.143998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:37.148525 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:37.170833 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.172019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.174810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.175726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.180717 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1056227606", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "networks": [{"uuid": "04987f12-459b-4dbd-bcc7-f34382b6c1a1"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:37.263968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:37.267812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] validate_networks() for [('04987f12-459b-4dbd-bcc7-f34382b6c1a1', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:51:37.290828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-835dce17-7ac1-44af-a9df-6e8241186b41 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1299 microversion: 2.1 time: 0.160248 Jun 24 23:51:37.292263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 242/451] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:37 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:37.354797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:37.355412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:37.362651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.363387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.364352 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.365063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.545281 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:37.555391 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a1f009c7-ab74-4be8-b73c-703b152b9c43 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.204702 Jun 24 23:51:37.557093 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 243/452] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:37 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:37.620037 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:37.621764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:37.631432 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.632824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.634939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.635630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.821304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:37.830763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7f06e809-c41f-4729-af17-6966baff875b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1372 microversion: 2.1 time: 0.216328 Jun 24 23:51:37.831334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 244/453] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:37 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:37.835938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:37.837052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:37.847348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.848119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.848625 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:37.849067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:37.925547 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:37.985711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:51:37.986421 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:51:37.987317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:51:37.987945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:51:37.988916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:51:38.002977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.004038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.006076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.006810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.011346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.020429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.022884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.024078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0af7942a-77cb-4271-892a-20bbd8ab1585 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1740 microversion: 2.20 time: 0.191829 Jun 24 23:51:38.024742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 245/454] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:37 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:38.034169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Getting quotas for project b45f691b51284dbbb7f1fd8d482af7e4. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:38.039414 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Getting quotas for user 6e416196a4614ccc90c8f2411e3f0258 and project b45f691b51284dbbb7f1fd8d482af7e4. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:38.056988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:51:38.060748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:51:38.062983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:38.063605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:38.078945 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.079405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.086346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.086903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.118026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a9495e4f-c5e8-43db-ba67-3f0300772272 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941034 Jun 24 23:51:38.124111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 210/455] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:51:38.131458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e9c32660-d1da-4170-b084-73c6c36a21c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:38.132805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e9c32660-d1da-4170-b084-73c6c36a21c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:38.229095 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e9c32660-d1da-4170-b084-73c6c36a21c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.239721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e9c32660-d1da-4170-b084-73c6c36a21c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1219 microversion: 2.1 time: 0.113534 Jun 24 23:51:38.243267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 211/456] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:38 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:38.316552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:38.317477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:38.337902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.341541 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.343744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.345321 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.413154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.425698 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2a667407-d4cd-46af-bd80-1a0edd4b89a2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.367679 Jun 24 23:51:38.427112 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 246/457] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:38 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:38.579816 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:38.582802 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:38.598891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.599338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.600118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.600556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.605005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=8 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:38.844323 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:38.854298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:38.874727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cd7c198b-653a-4e83-8662-783913ff7ae5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.304216 Jun 24 23:51:38.876146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 247/458] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:38 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:38.892758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:38.893808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:38.902382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.902382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:38.903191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:38.903627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.079680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.091118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c032ec18-5306-49cf-be15-71b1e1789b85 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1566 microversion: 2.1 time: 0.202939 Jun 24 23:51:39.092779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 248/459] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:38 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:39.099876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:39.100722 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:39.109901 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.110445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.111304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.111812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.146023 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.150325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:39.163724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-287b5bf7-8386-45c1-8a99-4f30776e5fbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.859171 Jun 24 23:51:39.181231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 212/460] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:38 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:39.191851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:39.193076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:39.205867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.206580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.207543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.209255 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.301931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.311805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.313927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.316196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f7cca2b0-a2db-4ade-a791-5b1a0e790f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1722 microversion: 2.20 time: 0.221420 Jun 24 23:51:39.316797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 249/461] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:39 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:39.332701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:39.333355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:39.339551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.339998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.340917 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.341353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.415217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.429621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fa5ece3a-4cc9-445e-bf33-36f38dd5d3db tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1215 microversion: 2.1 time: 0.111540 Jun 24 23:51:39.430200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 250/462] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:39 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:39.436751 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6e972a9d-acb6-4261-8990-4e55a7e746fe tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254610 Jun 24 23:51:39.443303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 213/463] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:51:39 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-interface => generated 285 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:39.448666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:39.449654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:39.458451 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.459277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.460290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.460804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.654987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1881933570", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "networks": [{"uuid": "ee1f8e02-2b45-4811-9ef8-1a5ead5b0d12"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:39.740350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] validate_networks() for [('ee1f8e02-2b45-4811-9ef8-1a5ead5b0d12', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:51:39.851958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:39.864108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-eca3e2d6-1b01-4583-8326-cf0d5fe93f8e tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.418851 Jun 24 23:51:39.873239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 251/464] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:39 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:39.893736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:39.894826 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:39.905897 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.909541 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:39.910433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:39.911699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.636522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:51:40.637812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:51:40.639229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:51:40.639721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:51:40.640886 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:51:40.650981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:40.654666 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.655618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.660658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.661240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8883d6a2-91b5-4d56-a1d8-67276a0a02d3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.771519 Jun 24 23:51:40.661362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.661989 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 252/465] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:39 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:40.672229 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-88aa2818-8433-4dec-9cde-f175e36cf267 req-7a5712e5-0d35-4685-9bcf-7cdfb8e9d44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "name": "network-vif-plugged", "status": "completed", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:40.681077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-88aa2818-8433-4dec-9cde-f175e36cf267 req-7a5712e5-0d35-4685-9bcf-7cdfb8e9d44a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.681938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-88aa2818-8433-4dec-9cde-f175e36cf267 req-7a5712e5-0d35-4685-9bcf-7cdfb8e9d44a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.683089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Getting quotas for project 9f579ab134df4b9f9ea9f6e2c035a7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:51:40.688674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Getting quotas for user 09c95554a3ea4476b2ce834b33de2bbf and project 9f579ab134df4b9f9ea9f6e2c035a7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:51:40.694815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-88aa2818-8433-4dec-9cde-f175e36cf267 req-7a5712e5-0d35-4685-9bcf-7cdfb8e9d44a service nova] Creating event network-vif-plugged:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:51:40.700486 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-88aa2818-8433-4dec-9cde-f175e36cf267 req-7a5712e5-0d35-4685-9bcf-7cdfb8e9d44a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036550 Jun 24 23:51:40.701310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 253/466] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:40.702658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:51:40.706194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:51:40.706597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:40.707459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:40.714522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.716137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.717455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.718083 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.769839 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e4c1bfdd-5438-4808-9cac-d4689dea04b2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118906 Jun 24 23:51:40.771418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 214/467] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:51:40.777375 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:40.778918 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:40.793158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.794158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.795482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:40.795924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:40.996190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.007292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.009500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.012071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8846f0d0-aa4e-4ecb-9237-54eb192ac2f0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1722 microversion: 2.20 time: 0.238285 Jun 24 23:51:41.012855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 215/468] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:40 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:41.023078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:41.023802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:41.032563 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.033179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.034111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.034661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.136998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.155969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.163623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4ce7b64f-e9cc-4e27-9034-be11116a1c5b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.461007 Jun 24 23:51:41.173509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5956fbee-6ffe-412e-8bb3-480ac4619847 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1277 microversion: 2.1 time: 0.150109 Jun 24 23:51:41.173509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 216/469] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:41 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:41.173925 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 254/470] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:40 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:41.174046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-0815e1e9-2671-4419-aaa8-4347874ad01e req-cd54ac52-1068-44ed-9507-030fe0f9abcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9248f71-33cb-4319-ba9c-e5e37aabf62e", "tag": "6bfc9eda-f044-468d-a90f-3c83c6a52fe2"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:41.177871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-82577d3f-f2a6-45a0-8f32-f40d2267d16a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:41.180827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-82577d3f-f2a6-45a0-8f32-f40d2267d16a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:41.193716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0815e1e9-2671-4419-aaa8-4347874ad01e req-cd54ac52-1068-44ed-9507-030fe0f9abcb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.194244 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0815e1e9-2671-4419-aaa8-4347874ad01e req-cd54ac52-1068-44ed-9507-030fe0f9abcb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.211396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-0815e1e9-2671-4419-aaa8-4347874ad01e req-cd54ac52-1068-44ed-9507-030fe0f9abcb service nova] Creating event network-changed:6bfc9eda-f044-468d-a90f-3c83c6a52fe2 for instance b9248f71-33cb-4319-ba9c-e5e37aabf62e on hv-cinder-84762 Jun 24 23:51:41.227275 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-0815e1e9-2671-4419-aaa8-4347874ad01e req-cd54ac52-1068-44ed-9507-030fe0f9abcb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060536 Jun 24 23:51:41.228173 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 217/471] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:41.235969 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:41.236773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:41.244368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.244904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.245671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.246424 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.320347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-82577d3f-f2a6-45a0-8f32-f40d2267d16a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.334988 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-82577d3f-f2a6-45a0-8f32-f40d2267d16a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1214 microversion: 2.1 time: 0.161968 Jun 24 23:51:41.336611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 255/472] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:41 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:41.614042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.622600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-efaa9a86-1961-42e5-853b-19c790f51de2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.392177 Jun 24 23:51:41.623220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 218/473] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:41 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:41.679316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:41.679927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:41.686225 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.686675 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.687458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.687881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.971140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:41.975199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-a0ed3b31-d3a3-48a2-bde0-a7156dcb8839 req-37509264-81a1-4ce9-8587-0a173a5f4e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:41.980109 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5ef7d6c0-1814-4d15-b8e6-6acedb888e3d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.304683 Jun 24 23:51:41.980799 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 256/474] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:41 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:41.984761 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-a0ed3b31-d3a3-48a2-bde0-a7156dcb8839 req-37509264-81a1-4ce9-8587-0a173a5f4e2b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:41.985325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-a0ed3b31-d3a3-48a2-bde0-a7156dcb8839 req-37509264-81a1-4ce9-8587-0a173a5f4e2b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:41.998562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-a0ed3b31-d3a3-48a2-bde0-a7156dcb8839 req-37509264-81a1-4ce9-8587-0a173a5f4e2b service nova] Creating event network-changed:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:51:42.003566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-a0ed3b31-d3a3-48a2-bde0-a7156dcb8839 req-37509264-81a1-4ce9-8587-0a173a5f4e2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031952 Jun 24 23:51:42.004276 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 219/475] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:42.031004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:42.032050 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:42.038872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.039874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.040684 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.041234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.182746 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:42.183545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:42.191789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.192247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.193595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.194085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.209417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.223082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.224623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.225791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-686fabc9-5fa3-4199-a2ad-687f252c767a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1722 microversion: 2.20 time: 0.198755 Jun 24 23:51:42.226348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 257/476] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:42.231587 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:42.232454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:42.238771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.239291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.240308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.240969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.349354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.358519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1ae69133-c640-452c-a2fa-244546946a52 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.181116 Jun 24 23:51:42.359192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 220/477] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:42.366093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:42.367095 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:42.375953 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.376396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.377210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.377677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.399580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.408551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4b7fb9c6-dd30-45f0-865f-7c7799a663f6 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.180874 Jun 24 23:51:42.409274 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 258/478] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:42.440883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.448607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-762cd44f-ca13-40ff-9933-f3237608638b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1266 microversion: 2.1 time: 0.087992 Jun 24 23:51:42.449208 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 221/479] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:42.648430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:42.652205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:42.660996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.661526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.662313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.662873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.714963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-b9a84787-a365-4265-958b-826417c4655a req-83507339-4b53-4d90-905a-8053b993e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "name": "network-vif-unplugged", "status": "completed", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:42.725732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-b9a84787-a365-4265-958b-826417c4655a req-83507339-4b53-4d90-905a-8053b993e610 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:42.726152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-b9a84787-a365-4265-958b-826417c4655a req-83507339-4b53-4d90-905a-8053b993e610 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:42.738961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-b9a84787-a365-4265-958b-826417c4655a req-83507339-4b53-4d90-905a-8053b993e610 service nova] Creating event network-vif-unplugged:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:51:42.744020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-b9a84787-a365-4265-958b-826417c4655a req-83507339-4b53-4d90-905a-8053b993e610 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032962 Jun 24 23:51:42.744970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 222/480] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:42.949470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:42.958100 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f5253a41-5509-4825-a948-ea173554f62c tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1260 microversion: 2.1 time: 0.322449 Jun 24 23:51:42.959217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 259/481] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:42.999861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.000560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.007588 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.008083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.008888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.009346 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.153044 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.161742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ead43e7e-6bbb-4db3-825d-ad53ac6e20e6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.167349 Jun 24 23:51:43.162512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 223/482] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:42 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:43.244377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.245151 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.252368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.252840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.253630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.254089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.375913 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.376881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.383864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.384313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.385164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.385629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.453131 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.464030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.465902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.467272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-85ea223d-7b39-4ebf-9e41-253ee368cf9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1722 microversion: 2.20 time: 0.226975 Jun 24 23:51:43.468868 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 260/483] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:43 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:43.485105 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.485816 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.492028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.492791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.494103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.494859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.536967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.550361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-46193c01-9208-4e2e-92ce-6df077c434b4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.178784 Jun 24 23:51:43.551259 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 224/484] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:43 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:43.556387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.557730 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.565577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.566032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.566854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.567465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.639096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.647064 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b82dcd94-65f0-40a3-a054-87d45da902c2 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1266 microversion: 2.1 time: 0.094485 Jun 24 23:51:43.647642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 225/485] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:43 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:43.874650 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:43.882016 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-530c8427-d100-458e-b7ef-442f916d3c4e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.402077 Jun 24 23:51:43.882569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 261/486] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:43 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:43.975176 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:43.975788 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:43.982593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.983046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:43.983912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:43.984341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.034235 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-598f1672-7e69-4386-b580-368a5844913f req-387931dd-1165-4b6a-b1a3-6b81308a697a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ebab06-bd99-4f9f-9324-b1789936be02", "tag": "0cbffe14-7671-4d8a-82b1-6dc6e789928a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:44.042422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-598f1672-7e69-4386-b580-368a5844913f req-387931dd-1165-4b6a-b1a3-6b81308a697a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.042872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-598f1672-7e69-4386-b580-368a5844913f req-387931dd-1165-4b6a-b1a3-6b81308a697a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.056366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-598f1672-7e69-4386-b580-368a5844913f req-387931dd-1165-4b6a-b1a3-6b81308a697a service nova] Creating event network-changed:0cbffe14-7671-4d8a-82b1-6dc6e789928a for instance 80ebab06-bd99-4f9f-9324-b1789936be02 on hv-cinder-84762 Jun 24 23:51:44.063596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-598f1672-7e69-4386-b580-368a5844913f req-387931dd-1165-4b6a-b1a3-6b81308a697a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032948 Jun 24 23:51:44.064196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 262/487] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:44.116281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.124231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0eccb68e-a9dc-4532-a1dc-c40a911b1976 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1445 microversion: 2.1 time: 0.152994 Jun 24 23:51:44.124814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 226/488] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:43 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:44.141206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.141914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.143846 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:44.149594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.150043 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.150807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.151244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.179126 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.179826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.186677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.187338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.188196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.188723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.301913 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.309583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-70c54c49-3637-46ef-9901-b3987dffb937 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1445 microversion: 2.1 time: 0.172838 Jun 24 23:51:44.310165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 263/489] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:44.363704 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.375558 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-86f5eb66-4126-4a66-b064-3c277ffbd878 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.200100 Jun 24 23:51:44.376131 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 227/490] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:44.486066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.486805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.493108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.493634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.494727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.495949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.567359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.567878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.573987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.574455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.575220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.575651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.710327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.718978 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2ab5cb7e-4229-4a38-9d10-23ddd3eed516 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.155448 Jun 24 23:51:44.719576 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 228/491] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:44.724317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.725158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.725492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.732012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.732840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.733834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.734600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.734894 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.736480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.737694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6e98b0c0-dcdb-4b55-9008-1b17d2d4b1bc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1722 microversion: 2.20 time: 0.255719 Jun 24 23:51:44.738250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 264/492] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:44.798268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:44.805567 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a5350458-b6b3-48bf-95a2-43f31cf68617 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1266 microversion: 2.1 time: 0.085025 Jun 24 23:51:44.806297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 229/493] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:44.899017 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:44.899628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:44.905625 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.906054 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:44.906815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:44.907250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.152214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:45.159835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b1fecfee-fe00-4227-8cb1-2878c2fd93c3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.264986 Jun 24 23:51:45.160623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 265/494] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:44 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:45.393015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:45.393651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:45.400847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.401225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.402193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.403248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.738932 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:45.739890 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:45.754313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.755608 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.757223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.757829 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.960378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:45.967092 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-69c1342d-f265-4af0-a926-7447947bcff0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.577619 Jun 24 23:51:45.975533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 230/495] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:45 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:45.982039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:45.983512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:45.989936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.990391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:45.991155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:45.991755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.106527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.110345 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:46.116636 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-af082afe-f4d2-438c-8161-f406ab4917cf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.382701 Jun 24 23:51:46.118073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 266/496] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:45 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:46.124139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:46.125756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:46.134330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.135120 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.136192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.136994 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.226630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.237080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.238645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.240370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-aafb4b9b-b7f2-4980-8cee-cb650de21f95 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1725 microversion: 2.20 time: 0.263546 Jun 24 23:51:46.254463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 231/497] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:45 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:46.260860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:46.261534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:46.272129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.272660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.273660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.274188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.297057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:46.321014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.330671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-29516a2f-abd2-4825-be5a-ddf24cc849b5 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1284 microversion: 2.1 time: 0.211534 Jun 24 23:51:46.340404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 267/498] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:46 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:46.340404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff1acf97-7a31-4485-aa9d-54fd4bc379aa"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:46.340404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:46.344383 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.344853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.345619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.347215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.693981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8d78c9b2-b1a9-447a-a573-117806cab96c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.361604 Jun 24 23:51:46.700163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 268/499] 10.222.0.47 () {62 vars in 1363 bytes} [Fri Jun 24 23:51:46 2022] POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:51:46.712824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:46.726219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3281c804-9356-4c82-837d-37701caeaabc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.470193 Jun 24 23:51:46.727983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 232/500] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:46 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:46.837872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:46.838458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:46.861485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.862054 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.862895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.864028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.906100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-6b82e843-1a11-40c2-9e3f-8c3e73520e5b req-5d250e47-1897-47e8-9e08-e9e0442e64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:46.916988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-6b82e843-1a11-40c2-9e3f-8c3e73520e5b req-5d250e47-1897-47e8-9e08-e9e0442e64a7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.917490 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-6b82e843-1a11-40c2-9e3f-8c3e73520e5b req-5d250e47-1897-47e8-9e08-e9e0442e64a7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.930951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-6b82e843-1a11-40c2-9e3f-8c3e73520e5b req-5d250e47-1897-47e8-9e08-e9e0442e64a7 service nova] Creating event network-changed:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:51:46.942797 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-6b82e843-1a11-40c2-9e3f-8c3e73520e5b req-5d250e47-1897-47e8-9e08-e9e0442e64a7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041226 Jun 24 23:51:46.944103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 233/501] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:46.986172 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:46.987254 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:46.997969 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:46.999009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:46.999770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.000211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.003448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6e2edc3f-f980-4d92-a214-7afc8e821c58 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/action" status: 202 len: 0 microversion: 2.20 time: 0.170174 Jun 24 23:51:47.004445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 269/502] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Jun 24 23:51:46 2022] POST /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:51:47.014864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:47.016874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:47.039747 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.041056 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.049112 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.049886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.558291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:47.571401 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-79466141-fa2b-4760-a591-d6d85c96ba0c tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1721 microversion: 2.1 time: 0.591294 Jun 24 23:51:47.571988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 234/503] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:46 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1721 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:47.587371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:47.588188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:47.595974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.596822 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.599619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.600253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.690595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:47.706853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:47.710322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:47.711889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-58aa5580-2722-41b1-ba12-67519c837c9c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1751 microversion: 2.20 time: 0.702599 Jun 24 23:51:47.713458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 270/504] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:47 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1751 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:47.720394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:47.721317 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:47.730230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.732284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.733706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.734386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.890842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:47.906047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e10a8409-05eb-4e0e-a8f1-29668dc64b36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1272 microversion: 2.1 time: 0.191029 Jun 24 23:51:47.906849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 271/505] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:47 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:47.914349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:47.915173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:47.923763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.924215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:47.925083 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:47.925520 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.113967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.127378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e461593a-f970-4903-9deb-55b717d1e27d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.543194 Jun 24 23:51:48.129182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 235/506] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:47 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:48.257140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.280255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e2f7d2e3-78ec-4e01-aedc-565e91778220 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.359470 Jun 24 23:51:48.293545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 272/507] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:47 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:48.589238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:48.590265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:48.598718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:48.605094 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.609230 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.610324 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.610974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.732726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:48.733338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:48.739425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.739872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.740656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.741092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.853393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.864503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c0703fd6-747d-4f3f-85c8-51095122a8c9 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1698 microversion: 2.1 time: 0.279104 Jun 24 23:51:48.865299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 236/508] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:48 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1698 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:48.883379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3bd17bf3-9d03-4e12-86f6-ff9c603752e5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:48.888019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.892028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3bd17bf3-9d03-4e12-86f6-ff9c603752e5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.892714 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3bd17bf3-9d03-4e12-86f6-ff9c603752e5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.906344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.909338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:48.910969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fb743460-eeb1-4198-92eb-92d3466d9624 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1751 microversion: 2.20 time: 0.183203 Jun 24 23:51:48.917661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3bd17bf3-9d03-4e12-86f6-ff9c603752e5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Going to try to start instance {{(pid=124093) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 23:51:48.921544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 273/509] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:48 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:48.929509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:48.930164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:48.939282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.939741 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.940521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.940990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.980834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3bd17bf3-9d03-4e12-86f6-ff9c603752e5 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action" status: 202 len: 0 microversion: 2.1 time: 0.101657 Jun 24 23:51:48.981872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 237/510] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:51:48 2022] POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:51:48.990644 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:48.991271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:48.998182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:48.998774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:48.999550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.000329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.081534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:49.088869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ff551209-b591-47ce-862c-e8fac0b2268b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.164700 Jun 24 23:51:49.090723 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 274/511] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:48 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:49.146589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:49.147782 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:49.154813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.155262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.156024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.156450 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.211192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:49.224646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-400eef59-30c7-472e-a26d-1b724b2cfaa6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1707 microversion: 2.1 time: 0.238300 Jun 24 23:51:49.226486 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 238/512] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:48 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1707 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:49.236046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-573c7e19-02e3-4682-bbc1-6dbdf79b272a req-13c0ca40-0f1b-4cb5-bc8c-f623bed6efc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4ed933-13f0-413f-a734-c4024a374702", "tag": "611730e1-3e51-4a29-ab77-c83d723ff663"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:49.243852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-573c7e19-02e3-4682-bbc1-6dbdf79b272a req-13c0ca40-0f1b-4cb5-bc8c-f623bed6efc7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.244293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-573c7e19-02e3-4682-bbc1-6dbdf79b272a req-13c0ca40-0f1b-4cb5-bc8c-f623bed6efc7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.256683 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-573c7e19-02e3-4682-bbc1-6dbdf79b272a req-13c0ca40-0f1b-4cb5-bc8c-f623bed6efc7 service nova] Creating event network-changed:611730e1-3e51-4a29-ab77-c83d723ff663 for instance 2d4ed933-13f0-413f-a734-c4024a374702 on hv-cinder-84762 Jun 24 23:51:49.261505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-573c7e19-02e3-4682-bbc1-6dbdf79b272a req-13c0ca40-0f1b-4cb5-bc8c-f623bed6efc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030970 Jun 24 23:51:49.262373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 239/513] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:49.298367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:49.299190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:49.299897 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:49.305938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cf2715e5-1a86-4efc-835b-ca88a0f6980b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.163841 Jun 24 23:51:49.306106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.306493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 275/514] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:49 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:49.306627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.307313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.307750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.441596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:49.452801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6d5f2926-ee35-4f5f-aedc-e53b91cd12e4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.157607 Jun 24 23:51:49.454197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 240/515] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:49 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:49.729895 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-6c90e42d-e997-48fc-a377-99521f940f66 req-6cd99f27-ddd5-4075-b3ce-bc20f19f2bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9248f71-33cb-4319-ba9c-e5e37aabf62e", "name": "network-vif-plugged", "status": "completed", "tag": "6bfc9eda-f044-468d-a90f-3c83c6a52fe2"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:49.741493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-6c90e42d-e997-48fc-a377-99521f940f66 req-6cd99f27-ddd5-4075-b3ce-bc20f19f2bc3 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.748916 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-6c90e42d-e997-48fc-a377-99521f940f66 req-6cd99f27-ddd5-4075-b3ce-bc20f19f2bc3 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.765456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-6c90e42d-e997-48fc-a377-99521f940f66 req-6cd99f27-ddd5-4075-b3ce-bc20f19f2bc3 service nova] Creating event network-vif-plugged:6bfc9eda-f044-468d-a90f-3c83c6a52fe2 for instance b9248f71-33cb-4319-ba9c-e5e37aabf62e on hv-cinder-84762 Jun 24 23:51:49.772497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-6c90e42d-e997-48fc-a377-99521f940f66 req-6cd99f27-ddd5-4075-b3ce-bc20f19f2bc3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045470 Jun 24 23:51:49.773795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 276/516] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:49.943017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:49.944052 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:49.954353 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.954974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:49.955762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:49.956202 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.108350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:50.109389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:50.119849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.120202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.122242 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.122801 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.354551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.363933 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9493fdf5-ca89-419b-80a8-73add2000cd3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.261206 Jun 24 23:51:50.365612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 277/517] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:50 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:50.373078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:50.373689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:50.384280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.385003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.386063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.387033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.445518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.455375 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.456912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.458089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e2ea6727-bfcd-431b-b624-8a61599fd8a6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1753 microversion: 2.20 time: 0.528996 Jun 24 23:51:50.469507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 241/518] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:49 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1753 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:50.469507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:50.469507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:50.470649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.471100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.471864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.472298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.525048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.533485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-159f7a6f-9562-49a6-9437-548c13191a4e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1707 microversion: 2.1 time: 0.166728 Jun 24 23:51:50.534043 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 278/519] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:50 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:50.538412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:50.539007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:50.545308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.545742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.546501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:50.546927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:50.609645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.617078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a6a8ee2c-d2f1-45b0-ba1b-adb996803b7f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.156788 Jun 24 23:51:50.618274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 242/520] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:50 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:50.676912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:50.684858 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f6c88281-71d3-4ac1-b9a3-80bf481f6a5f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.149773 Jun 24 23:51:50.685433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 279/521] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:50 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:51.381194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:51.381862 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:51.383815 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:51.384538 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=14 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:51.391952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.392396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.393288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.393757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.477364 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:51.482999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:51.485572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:51.498998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.499725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.501696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.504224 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.526526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:51.535809 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.554916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4f615ba2-013b-45bd-8864-d3856db2271d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.177426 Jun 24 23:51:51.555522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 243/522] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:51 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:51.571511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:51.572455 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:51.579043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.579702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.581227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.581963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.659594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.669257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.670789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.671973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a446f45b-b94e-460f-8e50-4e2ebd53fcff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.198494 Jun 24 23:51:51.672527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 280/523] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:51 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:51.677451 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:51.678483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:51.685949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.686707 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.687688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.688126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.716836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.727984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ddbe8ca3-239d-4ca2-bc69-f7debd168dba tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1711 microversion: 2.1 time: 0.160177 Jun 24 23:51:51.728935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 244/524] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:51 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:51.734402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:51.735249 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:51.742050 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.742854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.743930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:51.744532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:51.844927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.852384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d64073eb-9203-442f-ae3d-75a2eee98bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1366 microversion: 2.1 time: 0.178511 Jun 24 23:51:51.852909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 281/525] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:51 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:51.881220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:51.889314 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2c4c74dc-c303-4997-999b-a55cf0667a5e tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.159254 Jun 24 23:51:51.889965 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 245/526] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:51 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:52.571257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:52.571779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:52.578403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.578848 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.579598 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.580027 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.689682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:52.690315 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:52.696768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.697213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.697976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.698404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.712887 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:52.722336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f5cad073-9029-4443-8b50-92b823d5b7f9 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.154900 Jun 24 23:51:52.722906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 282/527] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:52 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:52.827903 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:52.836327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:52.837865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:52.839020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d9cadefa-3f0e-4c2a-b50f-615c8d90af10 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.153217 Jun 24 23:51:52.840113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 246/528] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:52 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:52.869108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:52.869725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:52.876828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.877279 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.878047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.878485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.906768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:52.907369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:52.915061 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.915596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:52.916453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:52.917070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.007550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:53.015326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-16ef3687-eb5d-4a18-b04f-0281fb935256 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1557 microversion: 2.1 time: 0.150103 Jun 24 23:51:53.016053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 283/529] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:52 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:53.032182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:53.032718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:53.038569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.039021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.039792 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.040229 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.051105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:53.059066 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b6090e16-2171-43fd-bd35-f35b23ad5a0c tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.156154 Jun 24 23:51:53.059590 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 247/530] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:52 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:53.116678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0097c103-912d-4f8f-b2ce-c6afd27f6f28 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088268 Jun 24 23:51:53.117230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 284/531] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:51:53 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:53.711472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-e6c44123-3251-47eb-980a-dd61084c29d5 req-0991d460-a390-46dd-9cdf-1ca7bb7fd771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ebab06-bd99-4f9f-9324-b1789936be02", "name": "network-vif-plugged", "status": "completed", "tag": "0cbffe14-7671-4d8a-82b1-6dc6e789928a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:53.721566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e6c44123-3251-47eb-980a-dd61084c29d5 req-0991d460-a390-46dd-9cdf-1ca7bb7fd771 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.722058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e6c44123-3251-47eb-980a-dd61084c29d5 req-0991d460-a390-46dd-9cdf-1ca7bb7fd771 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.738681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-e6c44123-3251-47eb-980a-dd61084c29d5 req-0991d460-a390-46dd-9cdf-1ca7bb7fd771 service nova] Creating event network-vif-plugged:0cbffe14-7671-4d8a-82b1-6dc6e789928a for instance 80ebab06-bd99-4f9f-9324-b1789936be02 on hv-cinder-84762 Jun 24 23:51:53.744500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:53.745083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-e6c44123-3251-47eb-980a-dd61084c29d5 req-0991d460-a390-46dd-9cdf-1ca7bb7fd771 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Jun 24 23:51:53.745490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:53.747973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 248/532] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:53.753819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.754349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.755199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.755736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.859142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:53.859879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:53.866300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.866743 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.867537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:53.867968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:53.992888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:54.003178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-12632e4c-c9a2-4cfe-9f6f-80e99995492d tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.266542 Jun 24 23:51:54.004121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 285/533] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:53 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:54.062474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:54.076529 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:54.077167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:54.078116 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:54.080779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:54.082349 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4fddbc0d-0910-4a1e-802b-0278964c450d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.228051 Jun 24 23:51:54.083338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 249/534] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:53 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:54.088416 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:54.089023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:54.090701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:54.092016 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:54.274190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-7bf0b44a-aa0c-4680-b316-8292d4ee189b req-970b3e96-2189-4adb-a0d3-0ef6aa7303df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9248f71-33cb-4319-ba9c-e5e37aabf62e", "tag": "6bfc9eda-f044-468d-a90f-3c83c6a52fe2"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:54.290719 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7bf0b44a-aa0c-4680-b316-8292d4ee189b req-970b3e96-2189-4adb-a0d3-0ef6aa7303df service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:54.296289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7bf0b44a-aa0c-4680-b316-8292d4ee189b req-970b3e96-2189-4adb-a0d3-0ef6aa7303df service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:54.300911 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:51:54.309993 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:54.311826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-7bf0b44a-aa0c-4680-b316-8292d4ee189b req-970b3e96-2189-4adb-a0d3-0ef6aa7303df service nova] Creating event network-changed:6bfc9eda-f044-468d-a90f-3c83c6a52fe2 for instance b9248f71-33cb-4319-ba9c-e5e37aabf62e on hv-cinder-84762 Jun 24 23:51:54.317512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-7bf0b44a-aa0c-4680-b316-8292d4ee189b req-970b3e96-2189-4adb-a0d3-0ef6aa7303df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048108 Jun 24 23:51:54.317662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-33d69758-96b0-450b-8315-d03c778c5f62 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.246125 Jun 24 23:51:54.318309 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 286/535] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:54 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:54.319058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 250/536] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:51:55.019437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:55.020041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:55.026868 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.027417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.028279 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.028749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.102612 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:55.103577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:55.112124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.112695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.113874 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.114021 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.172719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:55.180396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4ec0e686-d4e9-414d-9514-0ddd5a0921ff tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.164797 Jun 24 23:51:55.181337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 287/537] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:55 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:55.334376 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:55.335039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:55.341685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.342201 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.343033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:55.343531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:55.428167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:55.442573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:55.444144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:55.445352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6aac7d13-77e7-4540-a5bb-d61fb27cf375 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.347580 Jun 24 23:51:55.446104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 251/538] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:55 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:55.498241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:55.505810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-81fe47eb-fe36-46c7-aea2-e94331c344a3 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1319 microversion: 2.1 time: 0.175358 Jun 24 23:51:55.506376 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 288/539] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:55 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:56.205015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:56.206050 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:56.218766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.219833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.221105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.222178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.429660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:56.437796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-00547a1b-7385-4629-963d-4b2fce89bf76 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.243949 Jun 24 23:51:56.438458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 252/540] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:56 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:51:56.463306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:56.463831 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:56.470671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.471111 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.471864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.472296 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.524109 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:56.524871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:56.531579 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.532031 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.532979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.533411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.642041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:56.658592 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:56.661131 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:56.662527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-68becd2e-6d1d-4068-87d2-7dbc6b15d155 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.203329 Jun 24 23:51:56.665866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 289/541] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:56 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:51:56.740515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:56.751547 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9c6fd325-3897-4c84-98c5-9fcd7e14e368 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1509 microversion: 2.1 time: 0.232002 Jun 24 23:51:56.753247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 253/542] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:56 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:56.769350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9629fc0-76af-4a7b-83ba-614f29122f66", "device": "/dev/sdb"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:56.771739 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:56.781301 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.782169 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:56.783277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:56.783864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.455954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:57.456555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:57.463012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:57.463459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.464213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:57.465240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.605976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:57.618508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9ac60884-033a-4a77-b0b0-79de0505be69 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.167435 Jun 24 23:51:57.629627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 254/543] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:57 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:57.685159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:57.685792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:57.692067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:57.692513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.693298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:57.693760 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.856009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:57.864957 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:57.866619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:57.867875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8ae45b06-b199-470c-821f-7b51cb1c2e08 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.187836 Jun 24 23:51:57.868752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 255/544] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:57 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:57.873848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-0cd6d381-cef5-4488-bbff-3beeceebfd6e req-3864d6f9-8a9d-43de-be3a-cea92bd38a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4ed933-13f0-413f-a734-c4024a374702", "name": "network-vif-plugged", "status": "completed", "tag": "611730e1-3e51-4a29-ab77-c83d723ff663"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:51:57.882636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0cd6d381-cef5-4488-bbff-3beeceebfd6e req-3864d6f9-8a9d-43de-be3a-cea92bd38a1c service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:57.883154 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0cd6d381-cef5-4488-bbff-3beeceebfd6e req-3864d6f9-8a9d-43de-be3a-cea92bd38a1c service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:57.895514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-0cd6d381-cef5-4488-bbff-3beeceebfd6e req-3864d6f9-8a9d-43de-be3a-cea92bd38a1c service nova] Creating event network-vif-plugged:611730e1-3e51-4a29-ab77-c83d723ff663 for instance 2d4ed933-13f0-413f-a734-c4024a374702 on hv-cinder-84762 Jun 24 23:51:57.900702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-0cd6d381-cef5-4488-bbff-3beeceebfd6e req-3864d6f9-8a9d-43de-be3a-cea92bd38a1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Jun 24 23:51:57.901491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 256/545] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:51:58.638843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:58.640022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:58.646253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:58.646698 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:58.647450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:58.647875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:58.792227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:58.800806 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a7afaaed-284a-499e-8649-ce919dd88f5e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.167061 Jun 24 23:51:58.801572 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 257/546] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:58 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:51:58.887814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:58.888420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:58.894601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:58.895046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:58.895816 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:58.896496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:59.038318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:59.047652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:59.049198 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:59.050379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3e036dc8-978c-42ff-aa00-13e306c5fb1b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.167022 Jun 24 23:51:59.050939 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 258/547] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:51:58 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:51:59.819109 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:51:59.819805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:51:59.827982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:59.828425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:59.829226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:51:59.829654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:51:59.976264 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:51:59.984757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a5357abf-402f-4ba6-a117-e3174276a039 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.169412 Jun 24 23:51:59.985520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 259/548] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:51:59 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:00.069647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:00.070179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:00.077005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:00.077456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:00.078234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:00.078668 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:00.216238 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:00.236197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:00.239641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:00.243258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-41c8bebd-8e68-46e1-862a-fc6cce36fbd1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.177484 Jun 24 23:52:00.243843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 260/549] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:00 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:01.002123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:01.002879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:01.009785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:01.010412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:01.011792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:01.012637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:01.159564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:01.168439 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-14622cda-befa-4742-a7e3-51fcff056ca6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.169725 Jun 24 23:52:01.169714 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 261/550] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:00 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:01.263960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:01.264503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:01.271302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:01.271756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:01.272566 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:01.273035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:01.408141 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:01.417075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:01.419100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:01.420266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-27b3b954-9d05-49a6-befe-181fab09c450 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.161301 Jun 24 23:52:01.429542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 262/551] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:01 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:02.186510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:02.187223 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:02.193576 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:02.194026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:02.194789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:02.195225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:02.334287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:02.342651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e5006eb6-44b7-4b8e-9767-83e6a4d67e40 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.160684 Jun 24 23:52:02.343448 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 263/552] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:02 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:02.439682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:02.440319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:02.446794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:02.447647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:02.448316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:02.448851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:02.587294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:02.606180 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:02.608187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:02.609406 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-39e78775-7d5c-451d-824d-0d52529b8204 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.174903 Jun 24 23:52:02.610168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 264/553] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:02 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:03.360227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:03.361030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:03.367818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:03.368269 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:03.369079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:03.369515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:03.511003 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:03.520357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cfa10f44-bb57-4e0a-8dce-847f1411f44f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.164775 Jun 24 23:52:03.521421 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 265/554] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:03 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:03.629528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:03.630054 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:03.637833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:03.638983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:03.639447 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:03.639882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:03.783739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:03.792560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:03.794167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:03.796956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e294beb8-af4a-4bd4-85f4-bb057a0221c9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.171536 Jun 24 23:52:03.796956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 266/555] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:03 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:04.538865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:04.540336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:04.547466 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:04.548325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:04.549345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:04.549984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:04.705024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:04.712408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9f10f1b0-4c30-467d-8743-3ec48ece1331 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.177638 Jun 24 23:52:04.712991 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 267/556] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:04 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:04.816072 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:04.816783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:04.822755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:04.823195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:04.824088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:04.824639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:04.827279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:04.981810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:04.991115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:04.992656 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:04.993857 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-adbcdd07-66c4-4e7c-83c4-826af0c7edfb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.182311 Jun 24 23:52:04.994392 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 268/557] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:04 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:05.730043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:05.730750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:05.738776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:05.739325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:05.740191 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:05.740736 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:05.877025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:05.884396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3f8bb84b-e73b-4bda-bc30-c7bc8d64d474 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.158601 Jun 24 23:52:05.884987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 269/558] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:05 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:06.014749 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:06.015216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:06.021884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:06.022331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:06.033627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:06.034077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:06.185118 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:06.194402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:06.195896 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:06.197083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-af9f0f78-4572-4a5a-bd7f-ec175fdea430 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.187945 Jun 24 23:52:06.197826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 270/559] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:06 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:06.781319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=57 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:06.870737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=60 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:06.901363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:06.901966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:06.908550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:06.909022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:06.909796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:06.910227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:07.044795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:07.052520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3fe5a85b-ef24-49ff-a7ef-308573de5052 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.155006 Jun 24 23:52:07.053105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 271/560] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:06 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:07.215775 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:07.216299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:07.222186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:07.222641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:07.223377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:07.223807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:07.354019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:07.362824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:07.364320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:07.365493 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c10ed25e-3cfe-4234-9724-59eb260ca9c0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.153589 Jun 24 23:52:07.366040 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 272/561] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:07 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:07.804173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8cef0695-d729-43be-ad4b-84ba928d56c7 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "POST /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.038836 Jun 24 23:52:07.804808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 290/562] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:51:56 2022] POST /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02/os-volume_attachments => generated 194 bytes in 11040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:08.069648 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:08.070298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:08.077407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:08.077864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:08.078628 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:08.079067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:08.208997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:08.216392 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a18f260e-c8d1-4876-af89-6cea14aefb23 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.150624 Jun 24 23:52:08.216960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 273/563] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:08 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:08.386110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:08.386804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:08.394398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:08.394851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:08.395616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:08.396307 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:08.538607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:08.547771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:08.549367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:08.550537 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-906c8bcf-a324-493c-8ff2-1c510eb83f91 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.169215 Jun 24 23:52:08.551124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 291/564] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:08 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:09.233971 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:09.234716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:09.241167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:09.241619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:09.242379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:09.242815 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:09.375437 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:09.382821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-20babecd-1f0c-48dc-8564-5850ad8909ad tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.153453 Jun 24 23:52:09.383370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 274/565] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:09 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:09.568824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:09.569366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:09.575740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:09.576182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:09.577485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:09.577911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:09.707000 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:09.715198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:09.716749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:09.718543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b5743850-ce22-4d83-bf7b-4af9b70ba2c4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.153579 Jun 24 23:52:09.719093 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 292/566] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:09 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:10.400328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:10.400939 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:10.407923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:10.408361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:10.409140 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:10.409571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:10.535253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:10.542651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-75ec5fc8-c092-4ff3-80e0-64b5fd7d405c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1314 microversion: 2.1 time: 0.146496 Jun 24 23:52:10.543214 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 275/567] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:10 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:10.737538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:10.738067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:10.744438 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:10.744919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:10.745682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:10.746118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:10.874931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:10.883164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:10.884689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:10.885836 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-42bd57ee-7c01-45f7-a25f-a3e139fef93f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.153122 Jun 24 23:52:10.886377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 293/568] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:10 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:11.560823 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:11.561675 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:11.568192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:11.569079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:11.569442 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:11.569878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:11.694040 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:11.701363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f9f68be0-a29e-4a86-8aef-f9f1f0897cdf tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1498 microversion: 2.1 time: 0.144577 Jun 24 23:52:11.702412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 276/569] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:11 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:11.906031 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:11.906717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:11.913200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:11.913639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:11.914394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:11.914822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:12.054645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:12.063256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:12.064800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:12.065964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cc55942f-2168-4b28-ba0a-7f448b42fa4d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.164319 Jun 24 23:52:12.069183 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 294/570] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:11 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:12.211418 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:12.211912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:12.218616 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:12.219062 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:12.219831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:12.220263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:12.247489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:52:12.321508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-95ace7ec-08bf-477a-b906-b98ff13fdc70 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 204 len: 0 microversion: 2.1 time: 0.113647 Jun 24 23:52:12.322077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 277/571] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:52:12 2022] DELETE /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:52:12.330524 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:12.331110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:12.337444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:12.337884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:12.338656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:12.339067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:12.465883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:12.473557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ce627594-851e-4917-9adf-ad0c8fe01fb7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1504 microversion: 2.1 time: 0.146967 Jun 24 23:52:12.474114 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 295/572] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:12 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:13.083561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:13.084358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:13.090660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:13.091107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:13.091872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:13.092312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:13.226446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:13.234933 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:13.236427 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:13.237641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-661b92a0-1ee0-4252-ab0e-bed6277c4545 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.158269 Jun 24 23:52:13.238265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 278/573] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:13 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:13.490980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:13.491560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:13.498073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:13.499505 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:13.500274 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:13.500744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:13.636009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:13.644095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4bd1dc24-74af-43d3-8542-9e4bb4bde044 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1504 microversion: 2.1 time: 0.157094 Jun 24 23:52:13.644669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 296/574] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:13 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:14.255721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:14.256252 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:14.262692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:14.263136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:14.263884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:14.264431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:14.394097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:14.402601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:14.404086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:14.405930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-60e59af9-16cc-470d-af48-1a6bcc2b0ac7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.153989 Jun 24 23:52:14.406476 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 279/575] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:14 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:14.661824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:14.662388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:14.668801 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:14.669249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:14.670013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:14.670511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:14.798483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:14.805844 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5d159b9a-f556-455f-a899-59e6b9864871 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1504 microversion: 2.1 time: 0.147948 Jun 24 23:52:14.806390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 297/576] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:14 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:15.423233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:15.423864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:15.430323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:15.430762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:15.431515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:15.431942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:15.565824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:15.574098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:15.575588 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:15.577260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0b49147d-b82e-4c2b-8bdc-4baeb3ebafda tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.157422 Jun 24 23:52:15.577963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 280/577] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:15 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:15.822784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:15.823303 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:15.830297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:15.830736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:15.831520 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:15.831945 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:15.962715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:15.970396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ef110fad-ca2b-4d2c-936d-c77872eea7bc tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1504 microversion: 2.1 time: 0.151579 Jun 24 23:52:15.970958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 298/578] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:15 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:16.595621 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:16.596226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:16.597573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-784d61de-e271-418b-a77d-7f6bc497483e req-3a4fd041-50bb-4c01-9018-7f0617260719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4ed933-13f0-413f-a734-c4024a374702", "name": "network-vif-deleted", "tag": "611730e1-3e51-4a29-ab77-c83d723ff663"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:16.602897 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:16.603344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:16.604161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:16.604653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:16.605473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-784d61de-e271-418b-a77d-7f6bc497483e req-3a4fd041-50bb-4c01-9018-7f0617260719 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:16.605911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-784d61de-e271-418b-a77d-7f6bc497483e req-3a4fd041-50bb-4c01-9018-7f0617260719 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:16.617292 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-784d61de-e271-418b-a77d-7f6bc497483e req-3a4fd041-50bb-4c01-9018-7f0617260719 service nova] Creating event network-vif-deleted:611730e1-3e51-4a29-ab77-c83d723ff663 for instance 2d4ed933-13f0-413f-a734-c4024a374702 on hv-cinder-84762 Jun 24 23:52:16.622449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-784d61de-e271-418b-a77d-7f6bc497483e req-3a4fd041-50bb-4c01-9018-7f0617260719 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028459 Jun 24 23:52:16.623040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 299/579] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:16.761878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:16.771273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:16.772815 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:16.774067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0d04b266-7582-4785-a2f3-d4cbb10781c7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.182325 Jun 24 23:52:16.774671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 281/580] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:16 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:16.988888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:16.989599 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:16.995771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:16.996218 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:16.997001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:16.997433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:17.028892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:17.029233 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:17.029702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lazy-loading 'fault' on Instance uuid 2d4ed933-13f0-413f-a734-c4024a374702 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:17.070934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:17.078411 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b5c98ef3-b108-4f12-92af-b2fbb84d1c7b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 200 len: 1304 microversion: 2.1 time: 0.094392 Jun 24 23:52:17.078964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 300/581] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:16 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:17.792740 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:17.793358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:17.799810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:17.800272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:17.801058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:17.801506 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:17.940998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:17.949993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:17.952102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:17.953357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0e97c905-8b18-4654-bcfa-874fff037793 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.164806 Jun 24 23:52:17.953905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 282/582] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:17 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:52:18.095257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:18.095856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 2d4ed933-13f0-413f-a734-c4024a374702] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:18.102241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.102682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:18.103431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.103879 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:18.117068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] HTTP exception thrown: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Request method failure captured: Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 HTTP/1.1 Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk4JpzkFUQ_hKKqyIJuH3DY-WZJIMqndSfUhAUEtXkMTgJBzOegggrBoLi0vry6m_FSrvbUNTigpNYM6eo--NlJMiE9RhG5CLlBWifppeUo6kJQu2ogD8-N9J7-EgpXqn-TumaETmg9U-2Q8w6g4AFVtuOdvpwfmIA70dRVAWvy-4ek Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 9f579ab134df4b9f9ea9f6e2c035a7fb Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:52:18.118702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}] Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 9f579ab134df4b9f9ea9f6e2c035a7fb Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesActionsTest-1207787642-project Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 09c95554a3ea4476b2ce834b33de2bbf Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesActionsTest-1207787642-project Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. Jun 24 23:52:18.120192 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '2d4ed933-13f0-413f-a734-c4024a374702'} Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:52:18.121159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. Jun 24 23:52:18.122645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:18.124720 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Returning 404 to user: Instance 2d4ed933-13f0-413f-a734-c4024a374702 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:52:18.124720 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cd18a558-2220-473a-a9a4-7a44baed095c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702" status: 404 len: 111 microversion: 2.1 time: 0.028736 Jun 24 23:52:18.124720 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 301/583] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:18 2022] GET /compute/v2.1/servers/2d4ed933-13f0-413f-a734-c4024a374702 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:52:18.171353 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-871154062", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "networks": [{"uuid": "ee1f8e02-2b45-4811-9ef8-1a5ead5b0d12"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:18.178076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:18.222927 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] validate_networks() for [('ee1f8e02-2b45-4811-9ef8-1a5ead5b0d12', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:52:18.565400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:52:18.565819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:52:18.566286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:52:18.566693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:52:18.567217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:52:18.579581 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.580020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:18.580841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.581272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:18.587672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:18.600413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Getting quotas for project 9f579ab134df4b9f9ea9f6e2c035a7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:52:18.604601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Getting quotas for user 09c95554a3ea4476b2ce834b33de2bbf and project 9f579ab134df4b9f9ea9f6e2c035a7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:52:18.615306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:52:18.617561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:52:18.661553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1767d8e2-a01e-42ac-8067-b4f0d0231fc7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494471 Jun 24 23:52:18.662190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 283/584] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:52:18.672115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d8cb6cab-3162-4ce7-9119-9f63a7cd9c10 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:18.672781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d8cb6cab-3162-4ce7-9119-9f63a7cd9c10 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:18.726745 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d8cb6cab-3162-4ce7-9119-9f63a7cd9c10 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:18.733481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d8cb6cab-3162-4ce7-9119-9f63a7cd9c10 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1213 microversion: 2.1 time: 0.065263 Jun 24 23:52:18.734045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 302/585] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:18 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:18.972191 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:18.972849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:18.979630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.980087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:18.980887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:18.981329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:19.112707 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:19.120963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:19.122468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:19.124167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bb8f98d9-2eef-4131-965e-7c42d229cdac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.155816 Jun 24 23:52:19.124756 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 284/586] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:18 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:19.750663 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:19.751297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:19.760364 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:19.760841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:19.761600 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:19.762027 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:19.824939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:19.832342 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2e6cda80-301a-4d58-91c8-9c15c014e3ea tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1217 microversion: 2.1 time: 0.086251 Jun 24 23:52:19.832949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 303/587] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:19 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:20.142404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:20.143010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:20.149750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:20.150197 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:20.150951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:20.151385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:20.284051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:20.292410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:20.293952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:20.295739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d136f064-7884-49d8-80ca-8aded41cdc1c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.156977 Jun 24 23:52:20.296290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 285/588] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:20 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:20.849435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:20.850305 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:20.856874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:20.857322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:20.858780 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:20.859221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:20.926018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:20.934022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c8bfe0b6-196f-41ba-a9fb-ac0807c640d6 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1209 microversion: 2.1 time: 0.088615 Jun 24 23:52:20.937128 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 304/589] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:20 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:21.314624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:21.315221 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:21.322034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:21.322477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:21.323239 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:21.323671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:21.541253 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:21.550788 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:21.552435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:21.554071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-21fc1045-b33e-4250-9a2f-e6a42526278c tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.243772 Jun 24 23:52:21.554160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 286/590] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:21 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:21.952059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:21.952667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:21.959847 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:21.960293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:21.961112 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:21.961545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:22.027328 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:22.036277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1db646ba-7c5a-43e0-a99e-75611e9e0d8f tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1271 microversion: 2.1 time: 0.088280 Jun 24 23:52:22.036896 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 305/591] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:21 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:22.572218 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:22.572789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:22.580488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:22.580974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:22.581744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:22.582179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:22.711294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:22.720607 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:22.722464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:22.724060 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cf49e2c8-6093-4f68-a08b-5368d82ce469 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.155704 Jun 24 23:52:22.724804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 287/592] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:22 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:23.053551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:23.054163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:23.061132 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:23.061590 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:23.062357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:23.062794 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:23.191445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:23.199059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9f921b3d-4ca5-495e-afc1-5f54414ce909 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.149352 Jun 24 23:52:23.199607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 306/593] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:23 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:23.742873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:23.743478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:23.750640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:23.751120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:23.751871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:23.752301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:23.879446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:23.887689 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:23.889289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:23.890420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-61e2cc9f-7739-421f-896f-25cbd5dada81 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.151608 Jun 24 23:52:23.891000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 288/594] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:23 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:24.216399 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:24.217645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:24.224119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:24.224574 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:24.225361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:24.225795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:24.363420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:24.371014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ae6b3966-7cf7-447e-8f19-2dbb16bf4e36 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.158386 Jun 24 23:52:24.371793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 307/595] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:24 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:24.607250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-5556d5d2-eefc-436c-86b1-12a63d769085 req-ac9b6fd2-79e6-4e44-a360-c9a591a3e00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74be67b6-d2f3-40c9-878a-6529f5172f16", "tag": "87c28589-e6ac-4991-bc25-dd4783f3b182"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:24.616069 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5556d5d2-eefc-436c-86b1-12a63d769085 req-ac9b6fd2-79e6-4e44-a360-c9a591a3e00e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:24.616617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5556d5d2-eefc-436c-86b1-12a63d769085 req-ac9b6fd2-79e6-4e44-a360-c9a591a3e00e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:24.628899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-5556d5d2-eefc-436c-86b1-12a63d769085 req-ac9b6fd2-79e6-4e44-a360-c9a591a3e00e service nova] Creating event network-changed:87c28589-e6ac-4991-bc25-dd4783f3b182 for instance 74be67b6-d2f3-40c9-878a-6529f5172f16 on hv-cinder-84762 Jun 24 23:52:24.633847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-5556d5d2-eefc-436c-86b1-12a63d769085 req-ac9b6fd2-79e6-4e44-a360-c9a591a3e00e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 Jun 24 23:52:24.634430 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 289/596] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:24.909339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:24.909951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:24.915926 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:24.916371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:24.917186 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:24.917626 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:24.922431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:25.061492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:25.070669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:25.072178 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:25.073368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0160c339-1a55-4140-a883-294d5773ef9f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.168078 Jun 24 23:52:25.073920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 308/597] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:24 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:25.227335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-b9a9132a-712c-4176-91ff-86d40101fed5 req-133d36ca-5a64-4529-8153-5e43c14225bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "name": "network-vif-plugged", "status": "completed", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:25.240487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-b9a9132a-712c-4176-91ff-86d40101fed5 req-133d36ca-5a64-4529-8153-5e43c14225bd service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:25.241033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-b9a9132a-712c-4176-91ff-86d40101fed5 req-133d36ca-5a64-4529-8153-5e43c14225bd service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:25.256032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-b9a9132a-712c-4176-91ff-86d40101fed5 req-133d36ca-5a64-4529-8153-5e43c14225bd service nova] Creating event network-vif-plugged:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:52:25.261269 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-b9a9132a-712c-4176-91ff-86d40101fed5 req-133d36ca-5a64-4529-8153-5e43c14225bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038421 Jun 24 23:52:25.262018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 290/598] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:25.387275 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:25.387804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:25.395068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:25.395522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:25.396567 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:25.397030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:25.525970 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:25.533433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2008d49d-7f28-4845-a9f1-9e6c7ba0291b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.150099 Jun 24 23:52:25.533981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 309/599] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:25 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:26.092251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:26.093009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:26.099399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:26.099853 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:26.100706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:26.101144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:26.291345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:26.300414 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:26.301942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:26.303098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-37475932-2cfd-4220-98f1-2e583f72a422 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.215569 Jun 24 23:52:26.303727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 291/600] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:26 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:26.550089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:26.550697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:26.557077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:26.557520 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:26.558280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:26.558712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:26.688689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:26.695950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d0016726-8265-4281-bef7-e4c4a01dfb63 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.149818 Jun 24 23:52:26.696537 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 310/601] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:26 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:27.321469 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:27.322019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:27.328788 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:27.329240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:27.330005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:27.330441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:27.467252 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:27.475879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:27.477460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:27.478631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c50aff34-424f-49f9-abce-bb1f6220bae9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.161250 Jun 24 23:52:27.479283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 292/602] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:27 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:27.713091 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:27.713730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:27.720867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:27.721326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:27.722172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:27.722736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:27.852309 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:27.860876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1c6e9e63-674f-43e3-94ee-fc0d26c36f99 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.151581 Jun 24 23:52:27.861435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 311/603] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:27 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:28.497554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:28.498121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:28.505239 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:28.505695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:28.506462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:28.506905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:28.589755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:28.610785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=6 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:28.636372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:28.645272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:28.647027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:28.648179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8225eb1b-3d89-447b-8f81-eb14d5007077 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.154680 Jun 24 23:52:28.648770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 293/604] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:28 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:28.878039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:28.878658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:28.881042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:28.886389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:28.886842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:28.887644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:28.888073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:29.227520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:29.228014 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:29.235136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:29.235929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:29.236878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:29.236996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:29.254637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:29.262243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0e44418b-d7e3-47c5-b747-ca0bb98db90a tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.388663 Jun 24 23:52:29.262999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 312/605] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:28 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:29.333326 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lazy-loading 'services' on Instance uuid 80ebab06-bd99-4f9f-9324-b1789936be02 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:29.408780 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-06675ccc-ac7f-44c2-a1c2-eede3c1872b4 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02/os-volume_attachments/b9629fc0-76af-4a7b-83ba-614f29122f66" status: 202 len: 0 microversion: 2.1 time: 0.184947 Jun 24 23:52:29.409369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 294/606] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:52:29 2022] DELETE /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02/os-volume_attachments/b9629fc0-76af-4a7b-83ba-614f29122f66 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:52:29.666811 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:29.667424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:29.674497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:29.674949 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:29.676121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:29.676798 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:29.816442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:29.826434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:29.827778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:29.828961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bb8cfdbc-b61e-4671-a667-a1272b2cd284 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1809 microversion: 2.20 time: 0.166573 Jun 24 23:52:29.839716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 313/607] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:29 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:30.279989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:30.280834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:30.288078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:30.288535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:30.289407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:30.289769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:30.428667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:30.437554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f3995094-d30c-4c3d-861c-b07b3f9139e1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.161699 Jun 24 23:52:30.438847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 295/608] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:30 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:30.848832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:30.849438 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:30.855866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:30.856313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:30.857103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:30.857539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:30.987601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:30.996073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:30.997621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:30.998819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8c998616-dddc-4fca-9343-76c82106da49 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1796 microversion: 2.20 time: 0.155680 Jun 24 23:52:30.999368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 314/609] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:52:30 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:52:31.260807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-7f303e9b-8baa-4789-b1d3-89a41467f099 req-351953d1-59a4-45a2-ab8c-5f16249a956b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be67b6-d2f3-40c9-878a-6529f5172f16", "name": "network-vif-plugged", "status": "completed", "tag": "87c28589-e6ac-4991-bc25-dd4783f3b182"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:31.269880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7f303e9b-8baa-4789-b1d3-89a41467f099 req-351953d1-59a4-45a2-ab8c-5f16249a956b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.270342 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7f303e9b-8baa-4789-b1d3-89a41467f099 req-351953d1-59a4-45a2-ab8c-5f16249a956b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.282310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-7f303e9b-8baa-4789-b1d3-89a41467f099 req-351953d1-59a4-45a2-ab8c-5f16249a956b service nova] Creating event network-vif-plugged:87c28589-e6ac-4991-bc25-dd4783f3b182 for instance 74be67b6-d2f3-40c9-878a-6529f5172f16 on hv-cinder-84762 Jun 24 23:52:31.287371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-7f303e9b-8baa-4789-b1d3-89a41467f099 req-351953d1-59a4-45a2-ab8c-5f16249a956b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Jun 24 23:52:31.288155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 296/610] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:52:31.455694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:31.456262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:31.462393 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.462845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.463606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.464046 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.573327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:31.573921 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:31.580310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.580808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.581580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.582022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.606550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:31.608510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:52:31.615468 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-61f37a8d-98a7-4c1b-a5d2-03e17721735c tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.163809 Jun 24 23:52:31.616035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 315/611] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:31 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:31.682993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-709b6295-9d1b-48b8-8c5a-74f32a58a217 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 204 len: 0 microversion: 2.1 time: 0.113653 Jun 24 23:52:31.683560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 297/612] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:52:31 2022] DELETE /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 23:52:31.691877 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:31.692482 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:31.699755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.700196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.700984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:31.701612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:31.834210 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:31.841760 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-916647e8-26ef-4325-a193-7092d74b55bc tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1515 microversion: 2.1 time: 0.154006 Jun 24 23:52:31.842343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 316/613] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:31 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:32.632220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:32.632997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:32.639661 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:32.640114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:32.641751 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:32.642010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:32.770465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:32.778027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1a6ced36-4cdb-4f33-8701-93c9ad0644d1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.150088 Jun 24 23:52:32.778583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 298/614] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:32 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:32.859821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:32.860477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:32.866867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:32.867315 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:32.868067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:32.868495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:32.998317 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:33.006606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-187356b9-209f-4c20-b875-88a24916177d tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1515 microversion: 2.1 time: 0.150886 Jun 24 23:52:33.007158 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 317/615] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:32 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:33.795123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:33.795729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:33.802782 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:33.803227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:33.803979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:33.804410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:33.933905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:33.942894 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f700bb79-d2f9-44d1-9fde-b7a0cab9e3a1 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1313 microversion: 2.1 time: 0.151480 Jun 24 23:52:33.943472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 299/616] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:33 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:34.023543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:34.024149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:34.030678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:34.031264 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:34.032022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:34.032464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:34.162970 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:34.170544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-545a9110-d5d4-4e5f-b906-ca11702f239f tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1515 microversion: 2.1 time: 0.151098 Jun 24 23:52:34.171152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 318/617] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:34 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:34.643314 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-8d4b3b63-48e9-4415-8d68-8bac7d54ace7 req-f7b989b8-eca5-444a-9d76-50d4c079ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ebab06-bd99-4f9f-9324-b1789936be02", "name": "network-vif-deleted", "tag": "0cbffe14-7671-4d8a-82b1-6dc6e789928a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:34.651363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-8d4b3b63-48e9-4415-8d68-8bac7d54ace7 req-f7b989b8-eca5-444a-9d76-50d4c079ed24 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:34.651805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-8d4b3b63-48e9-4415-8d68-8bac7d54ace7 req-f7b989b8-eca5-444a-9d76-50d4c079ed24 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:34.656743 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:34.667189 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-8d4b3b63-48e9-4415-8d68-8bac7d54ace7 req-f7b989b8-eca5-444a-9d76-50d4c079ed24 service nova] Creating event network-vif-deleted:0cbffe14-7671-4d8a-82b1-6dc6e789928a for instance 80ebab06-bd99-4f9f-9324-b1789936be02 on hv-cinder-84762 Jun 24 23:52:34.673295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-8d4b3b63-48e9-4415-8d68-8bac7d54ace7 req-f7b989b8-eca5-444a-9d76-50d4c079ed24 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033551 Jun 24 23:52:34.673898 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 300/618] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:34.964005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:34.965128 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:34.983166 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:34.983699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:34.987415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:34.987930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.134580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:35.142107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c0d05b9f-e253-4f24-b0b3-abbaf1c539a8 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1496 microversion: 2.1 time: 0.186607 Jun 24 23:52:35.142655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 319/619] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:34 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1496 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:35.188357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:35.188879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:35.197772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.198220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.198981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.199412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.230874 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.231243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.231682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lazy-loading 'fault' on Instance uuid 80ebab06-bd99-4f9f-9324-b1789936be02 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:35.275866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e416196a4614ccc90c8f2411e3f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f691b51284dbbb7f1fd8d482af7e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:35.283362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e1aa7853-ce97-428f-918e-23ded3d70f18 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 200 len: 1309 microversion: 2.1 time: 0.099878 Jun 24 23:52:35.283909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 301/620] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:35 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:35.641145 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:35.641643 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:35.647782 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.648226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.649077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.649511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.675039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:52:35.760598 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-34cd6d10-c45d-4158-ba29-786988a40f9e tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 204 len: 0 microversion: 2.1 time: 0.122803 Jun 24 23:52:35.761601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 320/621] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:52:35 2022] DELETE /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:52:35.769611 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:35.770225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:35.776302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.776786 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.777580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:35.778017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:35.910287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:35.917672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-aa276baa-830c-4078-98d9-e44a2a4e43d3 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1502 microversion: 2.1 time: 0.151906 Jun 24 23:52:35.918232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 302/622] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:35 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:36.301121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:36.301828 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] [instance: 80ebab06-bd99-4f9f-9324-b1789936be02] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:36.308419 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:36.308908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:36.309666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:36.310095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:36.323075 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] HTTP exception thrown: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Request method failure captured: Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 HTTP/1.1 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk2vHh_3zP-JoopJoSlNnK9af-qO13MF2YVaeNtV4-91xuWq0piNLzkDNoAYFs480MMP05KouNHWykEStPCt9LxCB1HWUskJu-ch6j3RCUgCUWDPxN6PRTGN88HvMjjnS9kYIS8szD7ThVXpyyBtBE2b916XoHIcUO0knS3fFbDcfAE Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: b45f691b51284dbbb7f1fd8d482af7e4 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:52:36.324704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b45f691b51284dbbb7f1fd8d482af7e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b45f691b51284dbbb7f1fd8d482af7e4"}]}] Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: b45f691b51284dbbb7f1fd8d482af7e4 Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-741748695 Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesSnapshotTestJSON-741748695-project Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 6e416196a4614ccc90c8f2411e3f0258 Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesSnapshotTestJSON-741748695-project Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. Jun 24 23:52:36.326291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '80ebab06-bd99-4f9f-9324-b1789936be02'} Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:52:36.327217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. Jun 24 23:52:36.329341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:36.330606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] Returning 404 to user: Instance 80ebab06-bd99-4f9f-9324-b1789936be02 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:52:36.330606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0a7501ec-eb90-48f5-aca3-b887e449b050 tempest-VolumesSnapshotTestJSON-741748695 tempest-VolumesSnapshotTestJSON-741748695-project] 10.222.0.47 "GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02" status: 404 len: 111 microversion: 2.1 time: 0.029328 Jun 24 23:52:36.330606 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 321/623] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:36 2022] GET /compute/v2.1/servers/80ebab06-bd99-4f9f-9324-b1789936be02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:52:36.935354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:36.936062 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:36.943573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:36.944100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:36.944941 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:36.945385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:37.072610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:37.080966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c491d810-f015-474f-bd6c-d0c8e149c0d7 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1502 microversion: 2.1 time: 0.149514 Jun 24 23:52:37.081525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 303/624] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:36 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:37.926555 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-ab97106c-55e0-48a8-a9ae-6cbb3968742a req-79caeb71-e0a2-466d-8e2a-8b68bef55641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be67b6-d2f3-40c9-878a-6529f5172f16", "name": "network-vif-deleted", "tag": "87c28589-e6ac-4991-bc25-dd4783f3b182"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:37.931047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:37.944536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ab97106c-55e0-48a8-a9ae-6cbb3968742a req-79caeb71-e0a2-466d-8e2a-8b68bef55641 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:37.945005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-ab97106c-55e0-48a8-a9ae-6cbb3968742a req-79caeb71-e0a2-466d-8e2a-8b68bef55641 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:37.962079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-ab97106c-55e0-48a8-a9ae-6cbb3968742a req-79caeb71-e0a2-466d-8e2a-8b68bef55641 service nova] Creating event network-vif-deleted:87c28589-e6ac-4991-bc25-dd4783f3b182 for instance 74be67b6-d2f3-40c9-878a-6529f5172f16 on hv-cinder-84762 Jun 24 23:52:37.967655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-ab97106c-55e0-48a8-a9ae-6cbb3968742a req-79caeb71-e0a2-466d-8e2a-8b68bef55641 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045175 Jun 24 23:52:37.968255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 322/625] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:38.098177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:38.098789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:38.105277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:38.105729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:38.106488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:38.106927 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:38.139315 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:38.139768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:38.140240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lazy-loading 'fault' on Instance uuid 74be67b6-d2f3-40c9-878a-6529f5172f16 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:38.181762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:38.189785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f03d9e1b-acbf-4f08-9a28-97c8bf504137 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1303 microversion: 2.1 time: 0.095502 Jun 24 23:52:38.190341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 304/626] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:38 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:39.207582 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:39.208268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:39.214978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:39.215403 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:39.216148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:39.216597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:39.248121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:39.248557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:39.249028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lazy-loading 'fault' on Instance uuid 74be67b6-d2f3-40c9-878a-6529f5172f16 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:39.293815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:39.302121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8bcba22b-e659-4fc1-8004-1613a8f328ac tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1303 microversion: 2.1 time: 0.099482 Jun 24 23:52:39.302673 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 323/627] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:39 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:40.319052 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:40.319605 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:40.326328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:40.326777 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:40.327577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:40.328647 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:40.359604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:40.360077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:40.360532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lazy-loading 'fault' on Instance uuid 74be67b6-d2f3-40c9-878a-6529f5172f16 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:40.399697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c95554a3ea4476b2ce834b33de2bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f579ab134df4b9f9ea9f6e2c035a7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:40.407633 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bb8af56e-3e04-4d81-a151-d2ed0e547c8b tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 200 len: 1303 microversion: 2.1 time: 0.092651 Jun 24 23:52:40.408185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 305/628] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:40 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:41.424422 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:41.425063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] [instance: 74be67b6-d2f3-40c9-878a-6529f5172f16] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:41.431562 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:41.432015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:41.432814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:41.433256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:41.437905 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:41.448807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] HTTP exception thrown: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Request method failure captured: Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 HTTP/1.1 Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk4JpzkFUQ_hKKqyIJuH3DY-WZJIMqndSfUhAUEtXkMTgJBzOegggrBoLi0vry6m_FSrvbUNTigpNYM6eo--NlJMiE9RhG5CLlBWifppeUo6kJQu2ogD8-N9J7-EgpXqn-TumaETmg9U-2Q8w6g4AFVtuOdvpwfmIA70dRVAWvy-4ek Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 9f579ab134df4b9f9ea9f6e2c035a7fb Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:52:41.451182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9f579ab134df4b9f9ea9f6e2c035a7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9f579ab134df4b9f9ea9f6e2c035a7fb"}]}] Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 9f579ab134df4b9f9ea9f6e2c035a7fb Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesActionsTest-1207787642 Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesActionsTest-1207787642-project Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 09c95554a3ea4476b2ce834b33de2bbf Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesActionsTest-1207787642-project Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. Jun 24 23:52:41.452418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '74be67b6-d2f3-40c9-878a-6529f5172f16'} Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:52:41.453977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. Jun 24 23:52:41.455289 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:52:41.456344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] Returning 404 to user: Instance 74be67b6-d2f3-40c9-878a-6529f5172f16 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:52:41.456344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-467fe920-549a-4544-b02b-cc819a64cc51 tempest-VolumesActionsTest-1207787642 tempest-VolumesActionsTest-1207787642-project] 10.222.0.47 "GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16" status: 404 len: 111 microversion: 2.1 time: 0.032655 Jun 24 23:52:41.456344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 324/629] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:41 2022] GET /compute/v2.1/servers/74be67b6-d2f3-40c9-878a-6529f5172f16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:52:47.201955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a8603bd-aacd-48cb-9f24-67ee373ba6ea"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:47.204354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:47.211222 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:47.212103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:47.213136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:47.213810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:47.507486 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fe2b06d0-2fbc-4186-a999-f3f7152e08d9 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309765 Jun 24 23:52:47.508089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 306/630] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:52:47 2022] POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:52:49.668710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:49.669083 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:49.678910 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.679361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.680515 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.680994 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.713502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7ce5c66b-dc0c-4f0a-8ba5-46b31cb783ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/ips" status: 200 len: 151 microversion: 2.1 time: 0.046782 Jun 24 23:52:49.724113 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 325/631] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:52:49 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:49.745770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d87b63bc-4866-4619-b76f-3c3232de0871"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:49.746987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:49.748966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:49.754139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.754735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.755808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.756405 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.851022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: POST /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/os-volume_attachments HTTP/1.1 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 74 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:52:49.852762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {"volumeAttachment": {"volumeId": "d87b63bc-4866-4619-b76f-3c3232de0871"}} Jun 24 23:52:49.854051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'server_id': 'b9248f71-33cb-4319-ba9c-e5e37aabf62e', 'body': {'volumeAttachment': {'volumeId': 'd87b63bc-4866-4619-b76f-3c3232de0871'}}} Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:49.854814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:49.855951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 400 to user: Invalid volume: volume d87b63bc-4866-4619-b76f-3c3232de0871 is already attached to instances: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e07648de-6487-4128-8cd6-905f07d7b45c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127716 Jun 24 23:52:49.857160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 307/632] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:52:49 2022] POST /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:52:49.864998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:49.865490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:49.872013 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.872457 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.873267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:49.873680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:49.903775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:52:50.005833 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-eefc17ee-c5ed-4760-b2e4-dc7fce205e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 204 len: 0 microversion: 2.1 time: 0.144500 Jun 24 23:52:50.009467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 326/633] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:52:49 2022] DELETE /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:52:50.015338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:50.015968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:50.023564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:50.024012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:50.024836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:50.025270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:50.176780 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:50.185865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-06d18292-3ea5-41ee-828f-f4d9bb21ce50 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.174767 Jun 24 23:52:50.186977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 308/634] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:50 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:51.206642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:51.207493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:51.214044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:51.214727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:51.215659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:51.216257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:51.380849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:51.390735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aa33b65f-7f4b-489a-af0d-222f0bb96d38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.187175 Jun 24 23:52:51.391326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 327/635] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:51 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:52.408153 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:52.408827 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:52.423303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:52.424038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:52.425132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:52.425728 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:52.636699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:52.645755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1846e834-9e87-488d-84cb-df7a10ad577a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.242123 Jun 24 23:52:52.646530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 309/636] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:52 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:53.665306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:53.667730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:53.675764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:53.676373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:53.677484 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:53.678393 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:53.834404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:53.845545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9aed450a-f105-4c3c-b0e7-b96ea5fc3dbf tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.185026 Jun 24 23:52:53.846317 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 328/637] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:53 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:54.863743 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:54.864571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:54.873075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:54.873632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:54.886762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:54.890176 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:55.206388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:55.208424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:55.222994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:55.225099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2c4ee33f-982d-4d97-a669-a0bec6ef6113 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.365095 Jun 24 23:52:55.225609 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 310/638] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:54 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:55.234998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:55.235586 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:55.236449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:55.236981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:55.265130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'flavor' on Instance uuid 43b00699-41e7-46ea-b9a6-6968cdb016df {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:55.421697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-be5b39b1-ac41-47c8-9259-c8fc796c4f60 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/action" status: 200 len: 32 microversion: 2.1 time: 0.219862 Jun 24 23:52:55.422813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 329/639] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:52:55 2022] POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:52:55.438401 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:55.441199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:55.454772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:55.456013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:55.457984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:55.458508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:56.118864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:56.129312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2a5358b5-a67f-4815-8a84-e88d84400191 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.698065 Jun 24 23:52:56.140795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 311/640] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:55 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:56.244716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:56.246137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:56.273931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:56.274398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:56.275174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:56.275604 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:56.471751 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:56.485835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-33b40514-b72b-4025-8eeb-2ab921e554ab tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1682 microversion: 2.1 time: 0.245655 Jun 24 23:52:56.488304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 330/641] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:56 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:57.103742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-0784dce9-9ce8-4326-b371-678d2c0ca2b9 req-4cb23cd7-7669-44ce-8d96-b9629d5749a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9248f71-33cb-4319-ba9c-e5e37aabf62e", "name": "network-vif-deleted", "tag": "6bfc9eda-f044-468d-a90f-3c83c6a52fe2"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:52:57.114712 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0784dce9-9ce8-4326-b371-678d2c0ca2b9 req-4cb23cd7-7669-44ce-8d96-b9629d5749a8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.115407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-0784dce9-9ce8-4326-b371-678d2c0ca2b9 req-4cb23cd7-7669-44ce-8d96-b9629d5749a8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.128837 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-0784dce9-9ce8-4326-b371-678d2c0ca2b9 req-4cb23cd7-7669-44ce-8d96-b9629d5749a8 service nova] Creating event network-vif-deleted:6bfc9eda-f044-468d-a90f-3c83c6a52fe2 for instance b9248f71-33cb-4319-ba9c-e5e37aabf62e on hv-cinder-84762 Jun 24 23:52:57.134885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-0784dce9-9ce8-4326-b371-678d2c0ca2b9 req-4cb23cd7-7669-44ce-8d96-b9629d5749a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Jun 24 23:52:57.135813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 312/642] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:52:57.147539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:57.149351 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:57.162335 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.164703 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.165671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.166095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.456676 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:57.470563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0117b230-d27d-467a-bc75-7eb424481069 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.326974 Jun 24 23:52:57.471139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 331/643] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:57 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:57.507287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:57.508316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:57.516804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.517532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.518577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.519221 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.571713 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:57.572662 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:57.573287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'fault' on Instance uuid b9248f71-33cb-4319-ba9c-e5e37aabf62e {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:57.648104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:57.671750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a18186b8-1641-437e-861c-913521865f00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 200 len: 1331 microversion: 2.1 time: 0.171180 Jun 24 23:52:57.684027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 313/644] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:57 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:52:58.489269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:58.490483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:58.501837 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:58.502596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:58.503564 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:58.504290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:58.679313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:58.698831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:58.699450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:58.699600 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f27172a8-e677-4bcd-917c-1036bbc52ca6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.214355 Jun 24 23:52:58.700442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 332/645] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:58 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:58.712884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:58.712884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:58.712884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:58.712884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:58.727727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e HTTP/1.1 Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:52:58.729944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:52:58.731724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'b9248f71-33cb-4319-ba9c-e5e37aabf62e'} Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:52:58.732812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:52:58.735382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:52:58.737636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:52:58.737636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6132897c-0630-478b-9292-5a8fb3da60dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 404 len: 111 microversion: 2.1 time: 0.038458 Jun 24 23:52:58.737636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 314/646] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:58 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:52:58.742141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0df501b1-e991-4a39-a652-dc46a8342c64 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '.version_select at 0x7f7a55c69310>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:58.801589 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0df501b1-e991-4a39-a652-dc46a8342c64 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438065276" status: 202 len: 0 microversion: 2.1 time: 0.063229 Jun 24 23:52:58.802171 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 333/647] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Jun 24 23:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438065276 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:52:59.701343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:59.702425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:59.709320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.710006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.711121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.711732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.717387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:59.718199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:59.730696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.737299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.738393 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.739117 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.833619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'services' on Instance uuid 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:52:59.863972 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:52:59.935349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:52:59.945974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-747d4396-a305-4460-ae1d-f3b41104f902 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.232421 Jun 24 23:52:59.946851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 334/648] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:52:59 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:52:59.964377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cce8d90f-5215-43ac-8186-2e96e8824a99 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments/d87b63bc-4866-4619-b76f-3c3232de0871" status: 202 len: 0 microversion: 2.1 time: 0.266018 Jun 24 23:52:59.968218 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:59.969226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:52:59.976202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.976852 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.978306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:52:59.978915 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:52:59.980533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 315/649] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:52:59 2022] DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments/d87b63bc-4866-4619-b76f-3c3232de0871 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:52:59.991906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:52:59.993305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:00.012537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:00.013727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:00.016110 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:00.016650 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:00.072349 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-db953fe8-ee3d-41c1-820d-9240e9faed2c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089486 Jun 24 23:53:00.079459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 316/650] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:52:59 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:00.153540 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lazy-loading 'services' on Instance uuid 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:53:00.313602 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ac8f3fd5-464f-4f2b-b56b-c3b27ba8aa3a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments/e63dad11-87a9-4f91-a711-bd619b333b8c" status: 202 len: 0 microversion: 2.1 time: 0.349732 Jun 24 23:53:00.314216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 335/651] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:52:59 2022] DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments/e63dad11-87a9-4f91-a711-bd619b333b8c => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:53:00.963531 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:00.964178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:00.971247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:00.971699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:00.972472 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:00.972954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:01.090961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:01.093172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:01.105325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:01.106194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:01.107140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:01.107744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:01.142798 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:01.155352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-14437ae1-d8cc-4520-a141-f66df8219093 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.195661 Jun 24 23:53:01.163671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9c006f6a-8a22-4cb0-a7ed-27c3c71d84e5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076521 Jun 24 23:53:01.166040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 336/652] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:53:01 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:01.169941 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 317/653] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:00 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:02.176042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:02.176694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:02.178293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:02.179696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:02.184749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.185204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.185987 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.187175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.187938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.188560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.189499 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.190103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.227010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-20770399-3039-4af6-a1d0-db2f46d72feb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053476 Jun 24 23:53:02.227997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 318/654] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:53:02 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 23:53:02.299871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:02.300561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:02.306890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.307645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.308451 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.309120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.340084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:53:02.384350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:02.394004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c1a73ecc-3d5b-4ee3-ae84-7c74961639c0 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.221521 Jun 24 23:53:02.394714 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 337/655] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:02 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:02.449071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-755b8651-4c4e-4cdc-876f-06df398ecf08 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 204 len: 0 microversion: 2.1 time: 0.153398 Jun 24 23:53:02.450255 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 319/656] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:53:02 2022] DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:53:02.459205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:02.460196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:02.467420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.468387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.469417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.470160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.497794 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:02.597847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d1de0ed4-3f7f-4ea6-807e-a18baf3de997 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:02.605951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d1de0ed4-3f7f-4ea6-807e-a18baf3de997 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.606619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d1de0ed4-3f7f-4ea6-807e-a18baf3de997 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.640769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d1de0ed4-3f7f-4ea6-807e-a18baf3de997 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Going to try to stop instance {{(pid=124093) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 23:53:02.695500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:02.700987 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d1de0ed4-3f7f-4ea6-807e-a18baf3de997 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action" status: 202 len: 0 microversion: 2.1 time: 0.106081 Jun 24 23:53:02.706112 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 320/657] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:53:02 2022] POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:53:02.706270 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e4bc5cdb-ef8f-457d-b904-99c7ad21cf2b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1680 microversion: 2.1 time: 0.250140 Jun 24 23:53:02.706678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 338/658] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:02 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:02.716102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:02.717092 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:02.724609 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.725080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.725882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:02.726318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:02.885243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:02.894315 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3f1e4b91-58f1-4973-9e20-d54217962602 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.182464 Jun 24 23:53:02.895879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 321/659] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:02 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:03.412023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:03.412653 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:03.419045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.419490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:03.420304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.420860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:03.554669 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:03.563014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7a6b001f-786a-4916-b43b-798e164d1d23 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.155172 Jun 24 23:53:03.563570 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 339/660] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:03 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:03.722748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:03.723389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:03.730926 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.731378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:03.732272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.732754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:03.877450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:03.885774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-da5c4f1b-bdf1-4c8b-b4db-67f1376d55e2 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1680 microversion: 2.1 time: 0.166794 Jun 24 23:53:03.886617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 322/661] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:03 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:03.915734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:03.916026 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:03.925165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.925637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:03.926618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:03.927119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:04.131136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:04.140397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-80231c08-d9e5-4c9a-9a30-54fe947fa9f4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.228575 Jun 24 23:53:04.141500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 340/662] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:03 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:04.581265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:04.582289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:04.589224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:04.590139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:04.591367 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:04.591909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:04.843790 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:04.853492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-100eb5a9-2962-4055-97b6-e9e21df5e2e7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.276637 Jun 24 23:53:04.854150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 323/663] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:04 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:04.904151 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:04.905191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:04.913920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:04.914668 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:04.915617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:04.916057 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:05.029768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:05.041893 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2c7c6546-effa-464a-bc9a-7ca51a065b36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 200 len: 1613 microversion: 2.1 time: 0.140265 Jun 24 23:53:05.044174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 341/664] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:04 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:05.158109 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:05.158757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:05.164716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:05.165167 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:05.165929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:05.166367 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:05.351470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-f370d9ea-218a-4f6d-8bd3-84653c41ecd1 req-fe9c57ba-a42a-4c2a-a22e-167f022de254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266fe95-e867-4be8-a5c5-8f60b19e1cb6", "name": "network-vif-deleted", "tag": "24ec8691-f6ed-4396-85ee-c50a25b71b9a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:05.377373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f370d9ea-218a-4f6d-8bd3-84653c41ecd1 req-fe9c57ba-a42a-4c2a-a22e-167f022de254 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:05.379473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f370d9ea-218a-4f6d-8bd3-84653c41ecd1 req-fe9c57ba-a42a-4c2a-a22e-167f022de254 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:05.382064 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:05.391350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f332ca36-d14a-4277-bb04-e7c92652151a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.237251 Jun 24 23:53:05.392479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 324/665] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:05 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:05.404670 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-f370d9ea-218a-4f6d-8bd3-84653c41ecd1 req-fe9c57ba-a42a-4c2a-a22e-167f022de254 service nova] Creating event network-vif-deleted:24ec8691-f6ed-4396-85ee-c50a25b71b9a for instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 on hv-cinder-84762 Jun 24 23:53:05.411355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-f370d9ea-218a-4f6d-8bd3-84653c41ecd1 req-fe9c57ba-a42a-4c2a-a22e-167f022de254 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068246 Jun 24 23:53:05.411962 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 342/666] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:53:05.872262 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:05.872966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:05.882826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:05.883308 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:05.885537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:05.886166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:06.054759 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:06.063906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:06.064709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:06.066056 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-dca7b6b0-fbcb-4eea-bf4e-8993298273cd tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.198002 Jun 24 23:53:06.076211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:06.076211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:06.076211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:06.076211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:06.078532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 325/667] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:05 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:06.100646 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 HTTP/1.1 Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:53:06.102318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:53:06.103737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '4266fe95-e867-4be8-a5c5-8f60b19e1cb6'} Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:53:06.104531 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:53:06.106033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:06.107384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:53:06.107384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-53ce2d99-cdb7-42be-bdaa-46bd63c40403 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 404 len: 111 microversion: 2.1 time: 0.045416 Jun 24 23:53:06.107384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 343/668] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:06 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:53:06.114235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d490b46a-0b3d-4acc-b509-45be435b7f53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '.version_select at 0x7f7a55a83160>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:06.137207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d490b46a-0b3d-4acc-b509-45be435b7f53 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-261450619" status: 202 len: 0 microversion: 2.1 time: 0.027992 Jun 24 23:53:06.137768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 326/669] 10.222.0.47 () {58 vars in 1217 bytes} [Fri Jun 24 23:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-261450619 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:53:06.414891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:06.415510 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:06.422802 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:06.423303 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:06.424078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:06.424508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:06.652154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:06.662720 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8b7552a9-eee8-44c0-a536-681feb78788e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.256869 Jun 24 23:53:06.663837 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 344/670] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:06 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:06.929317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-324e80b3-2a32-4e63-9f86-c3d30da83ab8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: .version_select at 0x7f7a55a514c0>, body: {"keypair": {"name": "tempest-keypair-1222786873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv5lvk6drTu5GJPHpm/YUare+g/D2N/ZrhJew1VLk55xBLP2JQb0GUUNU/E07XlVba4R1es1ypTf4kwRTn2uw/OLVlr6vG3mUP9WKqMUgsosIFRsPbgaec3El3Z6/liWA=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:06.947178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-324e80b3-2a32-4e63-9f86-c3d30da83ab8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:53:06.950951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-324e80b3-2a32-4e63-9f86-c3d30da83ab8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:53:06.974484 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-324e80b3-2a32-4e63-9f86-c3d30da83ab8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049599 Jun 24 23:53:06.975076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 327/671] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:53:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:53:07.083471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:07.084081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:07.091279 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:07.091576 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:07.093412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:07.093815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:07.248321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:07.260321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0af17ac4-5043-42fe-9aa6-417332b1435a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.180526 Jun 24 23:53:07.261205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 345/672] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:07 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:07.679573 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:07.680188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:07.687422 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:07.688008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:07.688835 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:07.689273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:07.853820 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:07.861947 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a4b86191-6ab7-48ce-aab5-199b71014a7f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.186473 Jun 24 23:53:07.863955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 328/673] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:07 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:08.278613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:08.279217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:08.281820 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:08.287476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.287908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.288697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.289129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.322681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1724478048", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b11b39b-22df-4ca5-82fe-6b58b236b565"}], "security_groups": [{"name": "tempest-securitygroup--1618778131"}], "key_name": "tempest-keypair-1222786873", "user_data": "}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:08.423467 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:08.427335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] validate_networks() for [('3b11b39b-22df-4ca5-82fe-6b58b236b565', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:53:08.431744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a3c7e7d8-28c1-4abe-9f24-cbb9d4f80c81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.156971 Jun 24 23:53:08.432300 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 346/674] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:08 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:08.788533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:53:08.789005 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:53:08.789505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:53:08.789918 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:53:08.790329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:53:08.799057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.799500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.800295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.800769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.817161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:53:08.821038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:53:08.832628 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:53:08.834870 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:53:08.883837 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1b6109de-34a0-4c69-b0e0-6736303546a4 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565352 Jun 24 23:53:08.884765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 329/675] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:53:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:53:08.890585 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:08.891657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:08.894982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cb7c37b0-42ed-42d8-9709-563cf0954e9d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:08.895856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cb7c37b0-42ed-42d8-9709-563cf0954e9d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:08.898918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.899431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.900555 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:08.901211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:08.984505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cb7c37b0-42ed-42d8-9709-563cf0954e9d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:08.992190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cb7c37b0-42ed-42d8-9709-563cf0954e9d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1242 microversion: 2.1 time: 0.100592 Jun 24 23:53:08.993244 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 330/676] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:08 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:09.080629 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:09.089613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b2460417-99bb-4941-95ac-77ca07f05da2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.214684 Jun 24 23:53:09.096614 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 347/677] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:08 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:09.449727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:09.450458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:09.458098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:09.458569 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:09.459423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:09.459939 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:09.606779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:09.615600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-24763615-2f56-4325-b58f-791b0bdcac8f tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.169902 Jun 24 23:53:09.616147 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 331/678] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:09 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:10.011063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:10.011691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:10.019503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.019952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.021283 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.021730 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.096342 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:10.104630 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8437ae3d-919a-4606-8bb2-4ff6acdad884 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1300 microversion: 2.1 time: 0.098512 Jun 24 23:53:10.105203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 348/679] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:10 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:10.114305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:10.114305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:10.114767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.115217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.115989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.116432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.294859 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:10.303373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a5eb5ec5-2d42-43a1-bd10-4f75fb9df975 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.199822 Jun 24 23:53:10.303945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 332/680] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:10 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:10.633069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:10.633682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:10.640563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.641040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.641824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:10.642266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:10.784857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:10.793188 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-42959f62-52bd-4ad3-a47b-7bebd370f1b3 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.163860 Jun 24 23:53:10.793960 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 349/681] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:10 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:11.122093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:11.122948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:11.131743 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.132703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.133652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.134274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.155407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:11.320719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:11.321386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:11.329256 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.329784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.330568 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.331003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.357897 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:11.365888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9f9828f9-cbac-40da-86d7-2793c93ad685 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.247879 Jun 24 23:53:11.366559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 333/682] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:11 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:11.474667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:11.485283 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-18be5466-bcca-4dd3-a4a3-99d8141f88a3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.168057 Jun 24 23:53:11.495661 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 350/683] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:11 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:11.699148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-fd987645-f8b1-493c-92c1-7c0c3c6e02fa req-1e97dbc6-9680-44bb-a4fb-f4571f0ebca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6825b3-9d28-448f-a8bd-7580e4da3246", "tag": "d884fcf0-de2a-48df-a182-394ee1bb281d"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:11.708480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-fd987645-f8b1-493c-92c1-7c0c3c6e02fa req-1e97dbc6-9680-44bb-a4fb-f4571f0ebca0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.709307 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-fd987645-f8b1-493c-92c1-7c0c3c6e02fa req-1e97dbc6-9680-44bb-a4fb-f4571f0ebca0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.724794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-fd987645-f8b1-493c-92c1-7c0c3c6e02fa req-1e97dbc6-9680-44bb-a4fb-f4571f0ebca0 service nova] Creating event network-changed:d884fcf0-de2a-48df-a182-394ee1bb281d for instance dc6825b3-9d28-448f-a8bd-7580e4da3246 on hv-cinder-84762 Jun 24 23:53:11.731009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-fd987645-f8b1-493c-92c1-7c0c3c6e02fa req-1e97dbc6-9680-44bb-a4fb-f4571f0ebca0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035553 Jun 24 23:53:11.732135 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 334/684] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:11.812180 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:11.812977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:11.819857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.820620 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.821418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:11.821866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:11.962764 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:11.974816 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2a727b07-808e-4db1-a07b-6b1030f9c002 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.167121 Jun 24 23:53:11.975523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 351/685] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:11 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:12.384262 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:12.384981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:12.391339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:12.391780 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:12.392533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:12.393058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:12.502849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:12.503481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:12.510139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:12.510581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:12.511339 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:12.511766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:12.522745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:12.530456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c9aa0ffb-ad38-48f5-91c5-59d9b3f98855 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.150841 Jun 24 23:53:12.531030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 335/686] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:12 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:12.641454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:12.649070 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-45c5bf1d-72dd-4fd2-90b0-520402150de0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.150645 Jun 24 23:53:12.649618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 352/687] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:12 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:12.992184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:12.993015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:12.999337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:12.999855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.000715 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:13.001218 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.135934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:13.146266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a57cfe9f-3dcc-42ad-a6a5-28e3c903e809 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.158143 Jun 24 23:53:13.147028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 336/688] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:12 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:13.548425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:13.549149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:13.555536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:13.555982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.556787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:13.557246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.667072 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:13.667704 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:13.675007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:13.675454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.676224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:13.676781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:13.686373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:13.693918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f81d1820-c90c-40c9-96fa-e3695500962b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.150619 Jun 24 23:53:13.694714 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 353/689] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:13 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:13.812415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:13.819850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-04796f42-1ef4-481f-bc75-8e3c3ea0453f tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1675 microversion: 2.1 time: 0.156641 Jun 24 23:53:13.820413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 337/690] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:13 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:14.163445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:14.164049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:14.170913 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.171317 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.172073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.172503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.303702 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:14.312756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e5388791-f743-40a9-80f6-f1e256d5dea6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.153127 Jun 24 23:53:14.314392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 354/691] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:14 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:14.711291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:14.711907 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:14.714321 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:14.719972 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.720423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.721219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.721658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.837425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:14.838090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:14.845667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.846121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.846893 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:14.847355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:14.852183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:14.860026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5cf6e6a6-9bab-4cf2-a81f-dfa4187d081e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.152639 Jun 24 23:53:14.860575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 338/692] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:14 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:14.981063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:14.989035 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1628f097-c060-4882-9d93-014bc65a9c89 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1652 microversion: 2.1 time: 0.155510 Jun 24 23:53:14.989588 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 355/693] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:14 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1652 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:15.005550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d076f892-4e87-422f-9f43-39896992b856 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:15.011488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d076f892-4e87-422f-9f43-39896992b856 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.011936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d076f892-4e87-422f-9f43-39896992b856 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.034739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d076f892-4e87-422f-9f43-39896992b856 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Going to try to start instance {{(pid=124093) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 23:53:15.075998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d076f892-4e87-422f-9f43-39896992b856 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action" status: 202 len: 0 microversion: 2.1 time: 0.074054 Jun 24 23:53:15.076473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 339/694] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:53:15 2022] POST /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:53:15.085233 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:15.085922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:15.092326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.093382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.094156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.094592 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.113009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:15.225649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:15.232893 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-80dcbdd6-b594-4acd-bcb7-82a6374fdf35 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1661 microversion: 2.1 time: 0.151502 Jun 24 23:53:15.233466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 356/695] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:15 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:15.333732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:15.334352 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:15.340441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.340925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.341688 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.342124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.483677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:15.491650 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cbc0e27e-8dc8-495f-90e5-30108cdf7756 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.162165 Jun 24 23:53:15.492195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 340/696] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:15 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:15.877018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:15.877651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:15.884151 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.884611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:15.885375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:15.885802 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:16.018875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:16.026442 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-99eb5a6b-4aad-4850-9447-59486094ee38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.153754 Jun 24 23:53:16.026999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 357/697] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:15 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:16.252084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:16.252652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:16.259184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:16.259629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:16.260385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:16.260847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:16.386031 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:16.393583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9cd9da7f-171f-47c0-978e-45916b7bf03d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1661 microversion: 2.1 time: 0.146305 Jun 24 23:53:16.394148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 341/698] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:16 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1661 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:16.509384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:16.510433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:16.516705 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:16.517243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:16.518254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:16.518759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:16.649797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:16.658560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e5ceedbd-f3f4-42e8-818a-2f64dd072432 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.153382 Jun 24 23:53:16.659126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 358/699] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:16 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:17.043301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:17.043823 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:17.050058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.050509 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.051272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.051728 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.176185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:17.183536 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ad5f4c08-2f9b-4a23-8012-e0e5fa46d048 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.144212 Jun 24 23:53:17.184096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 342/700] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:17 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:17.411394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:17.412036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:17.418535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.418978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.419749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.420182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.554901 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:17.563314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bb86e93e-5717-44cf-8311-77b68c202dee tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1661 microversion: 2.1 time: 0.155675 Jun 24 23:53:17.573115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 359/701] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:17 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:17.676291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:17.677038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:17.683685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.684170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.685001 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:17.685473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:17.825137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:17.834269 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e164599d-6752-4387-b217-458f8537a867 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.161830 Jun 24 23:53:17.836614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 343/702] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:17 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:18.201430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:18.202585 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:18.208527 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.209007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.209763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.210196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.336633 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:18.344609 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-544374a6-cd35-475b-81bc-4c3b556b65ca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.147042 Jun 24 23:53:18.345173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 360/703] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:18 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:18.580830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:18.581350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:18.587291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.587738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.588497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.588958 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.808142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:18.849645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:18.853261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:18.854046 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:18.857341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2732ffae-902d-4662-9329-ad83c2a63683 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1661 microversion: 2.1 time: 0.280930 Jun 24 23:53:18.857913 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 344/704] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:18 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1661 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:18.871853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.871853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.871853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.871853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.943529 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:18.944024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:18.950751 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.951416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.953532 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:18.953981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:18.988213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-29db330b-91fc-41d0-94d2-0f798e237363 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments/ff1acf97-7a31-4485-aa9d-54fd4bc379aa" status: 200 len: 194 microversion: 2.20 time: 0.048671 Jun 24 23:53:18.988834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 345/705] 10.222.0.47 () {60 vars in 1453 bytes} [Fri Jun 24 23:53:18 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments/ff1acf97-7a31-4485-aa9d-54fd4bc379aa => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:53:19.022386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:19.033181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-33d30220-4091-458e-b7c8-366bffa3bfca tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.184447 Jun 24 23:53:19.033997 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 361/706] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:18 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:19.060611 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:19.061132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:19.063627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=12 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:19.069039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.069488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.070252 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.071144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.175808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lazy-loading 'services' on Instance uuid cb534158-a606-4d20-89de-2c7c5cbfa9a7 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:53:19.255993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5a333436-bab5-4da4-82f3-81adb820e9ed tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments/ff1acf97-7a31-4485-aa9d-54fd4bc379aa" status: 202 len: 0 microversion: 2.20 time: 0.198908 Jun 24 23:53:19.256748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 346/707] 10.222.0.47 () {60 vars in 1456 bytes} [Fri Jun 24 23:53:19 2022] DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments/ff1acf97-7a31-4485-aa9d-54fd4bc379aa => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 23:53:19.265957 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:19.267219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:19.274850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.275458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.276351 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.276987 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.314129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4f62bda2-c568-4955-91bb-f600b2056c26 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052711 Jun 24 23:53:19.314970 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 362/708] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Jun 24 23:53:19 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 23:53:19.362199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:19.362979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:19.369528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.370041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.370888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.371465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.512471 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:19.520904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-376f7988-9a2d-4c08-ae1a-242f7c318e5e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.163094 Jun 24 23:53:19.521467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 347/709] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:19 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:19.594465 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-fe0680e1-8686-4075-98a4-bc9a36d8b84c req-3b57446c-dafd-4607-aab9-0ef901e93af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6825b3-9d28-448f-a8bd-7580e4da3246", "name": "network-vif-plugged", "status": "completed", "tag": "d884fcf0-de2a-48df-a182-394ee1bb281d"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:19.602765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-fe0680e1-8686-4075-98a4-bc9a36d8b84c req-3b57446c-dafd-4607-aab9-0ef901e93af6 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.603207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-fe0680e1-8686-4075-98a4-bc9a36d8b84c req-3b57446c-dafd-4607-aab9-0ef901e93af6 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.614981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-fe0680e1-8686-4075-98a4-bc9a36d8b84c req-3b57446c-dafd-4607-aab9-0ef901e93af6 service nova] Creating event network-vif-plugged:d884fcf0-de2a-48df-a182-394ee1bb281d for instance dc6825b3-9d28-448f-a8bd-7580e4da3246 on hv-cinder-84762 Jun 24 23:53:19.619934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-fe0680e1-8686-4075-98a4-bc9a36d8b84c req-3b57446c-dafd-4607-aab9-0ef901e93af6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029127 Jun 24 23:53:19.620709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 363/710] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:19.875973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:19.876488 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:19.882952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.883400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:19.884161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:19.884610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.015552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:20.017862 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:20.024319 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-42590079-6883-40b8-9cc6-9e8eac482567 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1661 microversion: 2.1 time: 0.152946 Jun 24 23:53:20.024911 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 348/711] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:19 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:20.051301 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:20.051992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:20.058713 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.059153 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.059910 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.060324 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.203548 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:20.214488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ffd8c90c-f8de-43e3-bba8-302aee2a4de5 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1736 microversion: 2.1 time: 0.167225 Jun 24 23:53:20.215310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 364/712] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:20 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:20.326110 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:20.327210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:20.334649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.335141 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.335845 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.336281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.366969 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d299e84a-61ca-4377-839f-76fe93742703 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045473 Jun 24 23:53:20.367522 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 349/713] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Jun 24 23:53:20 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:53:20.537468 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:20.537889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:20.543690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.544127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.544918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:20.545344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:20.677384 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:20.684815 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4ce2dbe7-b3c3-4f0f-973c-c73c3e6a8f8b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.151348 Jun 24 23:53:20.685373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 365/714] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:20 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:21.042128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.042738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.049285 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.049733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.050498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.050938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.206705 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:21.214711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a2af1a4c-aa3a-442c-80d1-901da824efb0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1665 microversion: 2.1 time: 0.176346 Jun 24 23:53:21.215211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 350/715] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:21 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:21.232786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.235135 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.241545 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.241998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.242765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.243200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.379325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:21.379528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.380299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.386789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.387324 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.387793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bfdb9a44-4caf-4ad6-8fb2-5542287a49af tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1716 microversion: 2.1 time: 0.159774 Jun 24 23:53:21.387993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.388481 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.388854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 366/716] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:21 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:21.429570 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6e471557-eafa-4e1e-b620-dcb1a5b5706d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054142 Jun 24 23:53:21.430507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 351/717] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Jun 24 23:53:21 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:53:21.517298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.517933 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.524660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.525143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.525973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.526416 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.614624 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] HTTP exception thrown: Cannot 'detach_volume' instance 43b00699-41e7-46ea-b9a6-6968cdb016df while it is in vm_state rescued Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Request method failure captured: Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments/1a8603bd-aacd-48cb-9f24-67ee373ba6ea HTTP/1.1 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1cBwVNNAxzE76WSZ8Z5p_LLGlX35aLEOjd_VyWHbkJiifV0IDEEgVkGvKSSQxP0JG63sFpYFnpscPv3x-NCeF5U4Rxs6iWTIElzw7WhF4qXW-Dh_TiZCRupUIRCRz_IIRhQuZqTHn5KIp0cMPM7pBr19m2AP0RUpt7rv7TP66P5FE Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:53:21.616216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}] Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 5eb7e8b4befd4d519b440c632b59e724 Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:53:21.617812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Cannot 'detach_volume' instance 43b00699-41e7-46ea-b9a6-6968cdb016df while it is in vm_state rescued Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'server_id': '43b00699-41e7-46ea-b9a6-6968cdb016df', 'id': '1a8603bd-aacd-48cb-9f24-67ee373ba6ea'} Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:53:21.618596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 43b00699-41e7-46ea-b9a6-6968cdb016df while it is in vm_state rescued Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 43b00699-41e7-46ea-b9a6-6968cdb016df while it is in vm_state rescued Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:53:21.620143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Returning 409 to user: Cannot 'detach_volume' instance 43b00699-41e7-46ea-b9a6-6968cdb016df while it is in vm_state rescued {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:53:21.621336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e2d3c39e-6638-4129-a052-c893c08d2c78 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments/1a8603bd-aacd-48cb-9f24-67ee373ba6ea" status: 409 len: 152 microversion: 2.1 time: 0.106095 Jun 24 23:53:21.621336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 367/718] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:53:21 2022] DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments/1a8603bd-aacd-48cb-9f24-67ee373ba6ea => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 23:53:21.626982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:21.627538 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.633966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.634449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.635210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.635644 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.702206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.702473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9802f863-3436-4621-bf9f-3b5bfaf5bb18 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/action" status: 202 len: 0 microversion: 2.1 time: 0.079216 Jun 24 23:53:21.703078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 352/719] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:53:21 2022] POST /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:53:21.703213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.710059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.710538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.711304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.711755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.712490 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:21.713358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:21.720818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.721288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.722140 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:21.722654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:21.847254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:21.854781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-85a92660-1283-4f5d-a9ed-7d08f8c5e5a5 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1368 microversion: 2.1 time: 0.156561 Jun 24 23:53:21.855337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 368/720] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:21 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:21.867331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:21.875807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-62299bf8-6a6e-45e8-afbd-01f8ab5710c1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1724 microversion: 2.1 time: 0.168205 Jun 24 23:53:21.876357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 353/721] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:21 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:22.442042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:22.443022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:22.450156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.450612 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.451389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.453058 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.487704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-47d0966d-c4d7-46eb-bb66-7050b4c35fc0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049681 Jun 24 23:53:22.488257 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 369/722] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Jun 24 23:53:22 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:22.545870 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:22.546364 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:22.553369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.553821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.554589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.555025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.585563 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:53:22.663423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-406f5f93-5c41-4e96-b0b5-3f68ccf14fe4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 204 len: 0 microversion: 2.20 time: 0.121205 Jun 24 23:53:22.664038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 354/723] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Jun 24 23:53:22 2022] DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 23:53:22.671886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:22.672509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:22.678421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.678862 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.679611 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.680040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.811977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:22.821306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:22.822939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:22.824234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b1294eb4-4c32-48d8-93d0-c30bc59552df tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.156127 Jun 24 23:53:22.824943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 370/724] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:22 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:22.872616 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:22.873332 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:22.881075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.881627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.882614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.883199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.893196 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:22.893817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:22.900068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.900525 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:22.901830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:22.902464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:23.084899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:23.095431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ad0d5864-bc67-43f6-a639-ab8e5167fd8f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1559 microversion: 2.1 time: 0.227469 Jun 24 23:53:23.106520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 355/725] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:22 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:23.110336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:23.112486 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:23.113007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:23.119007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:23.119466 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:23.119712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c5c71296-7a38-47cc-bca3-f55b07f02a5b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1724 microversion: 2.1 time: 0.230312 Jun 24 23:53:23.120227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:23.120450 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 371/726] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:22 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:53:23.131343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:23.208643 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-276735bc-63c5-4e20-8174-8d9afba2a977 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100472 Jun 24 23:53:23.209254 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 356/727] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:53:23 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:23.842803 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:23.843427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:23.850316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:23.850866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:23.851662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:23.852237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:24.140741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:24.141364 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:24.148029 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:24.148478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:24.149283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:24.149723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:24.199292 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:24.205323 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:24.206921 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:24.208307 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1d97d44a-40f7-4466-a27d-cbfcdd1e80bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.369556 Jun 24 23:53:24.209452 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 372/728] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:23 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:24.351112 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:24.364776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7a3743c7-cf9f-44bb-833f-ce3ff3aee308 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1724 microversion: 2.1 time: 0.230250 Jun 24 23:53:24.365618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 357/729] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:24 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:24.492211 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-de90156e-618c-4a15-b3a9-e109990693bb req-16f6cbff-8ca4-4632-846b-3430bf7e3951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6825b3-9d28-448f-a8bd-7580e4da3246", "tag": "d884fcf0-de2a-48df-a182-394ee1bb281d"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:24.503277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-de90156e-618c-4a15-b3a9-e109990693bb req-16f6cbff-8ca4-4632-846b-3430bf7e3951 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:24.503277 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-de90156e-618c-4a15-b3a9-e109990693bb req-16f6cbff-8ca4-4632-846b-3430bf7e3951 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:24.515061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-de90156e-618c-4a15-b3a9-e109990693bb req-16f6cbff-8ca4-4632-846b-3430bf7e3951 service nova] Creating event network-changed:d884fcf0-de2a-48df-a182-394ee1bb281d for instance dc6825b3-9d28-448f-a8bd-7580e4da3246 on hv-cinder-84762 Jun 24 23:53:24.520456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-de90156e-618c-4a15-b3a9-e109990693bb req-16f6cbff-8ca4-4632-846b-3430bf7e3951 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Jun 24 23:53:24.521293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 373/730] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:25.226295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:25.226919 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:25.234126 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:25.234575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:25.235365 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:25.235802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:25.384047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:25.385107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:25.392134 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:25.393060 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:25.393798 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:25.396438 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:25.417128 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:25.555125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:25.567111 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-07fcddb4-2a85-43a5-aa19-009e7dd21e0b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1724 microversion: 2.1 time: 0.186250 Jun 24 23:53:25.568099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 374/731] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:25 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:25.782027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:25.797211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:25.798908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:25.800247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0baa16f1-8a7d-42dd-8322-d1c533fe061f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1724 microversion: 2.20 time: 0.577993 Jun 24 23:53:25.800958 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 358/732] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:25 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1724 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:25.975015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-d61d815f-8e78-4fca-bfc9-ab3e72f66368 req-a131d9b8-912a-4a75-94c4-eaad9793fdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb534158-a606-4d20-89de-2c7c5cbfa9a7", "name": "network-vif-deleted", "tag": "13fbc2db-fad2-498c-8df5-86a1f348a22b"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:25.985265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d61d815f-8e78-4fca-bfc9-ab3e72f66368 req-a131d9b8-912a-4a75-94c4-eaad9793fdb0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:25.985777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d61d815f-8e78-4fca-bfc9-ab3e72f66368 req-a131d9b8-912a-4a75-94c4-eaad9793fdb0 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:25.997552 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-d61d815f-8e78-4fca-bfc9-ab3e72f66368 req-a131d9b8-912a-4a75-94c4-eaad9793fdb0 service nova] Creating event network-vif-deleted:13fbc2db-fad2-498c-8df5-86a1f348a22b for instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 on hv-cinder-84762 Jun 24 23:53:26.006387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-d61d815f-8e78-4fca-bfc9-ab3e72f66368 req-a131d9b8-912a-4a75-94c4-eaad9793fdb0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035071 Jun 24 23:53:26.007326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 375/733] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:26.586033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:26.586642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:26.593604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:26.594057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:26.594830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:26.595296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:26.731250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:26.740097 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b040617d-d4a0-4c11-8d54-78e942ee2e40 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1724 microversion: 2.1 time: 0.158283 Jun 24 23:53:26.740706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 359/734] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:26 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:26.820378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:26.821129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:26.828571 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:26.829053 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:26.829837 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:26.830278 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:26.863171 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:26.863622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:26.864078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lazy-loading 'fault' on Instance uuid cb534158-a606-4d20-89de-2c7c5cbfa9a7 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:53:26.913679 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:26.922341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:26.923849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:26.925052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bb41b276-9ccf-4a42-9f04-cc42f010db1a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 200 len: 1371 microversion: 2.20 time: 0.109497 Jun 24 23:53:26.925619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 376/735] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:26 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:27.757396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:27.758013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:27.764464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.765069 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.766042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.766487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.899012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:27.908104 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-191b9249-23d7-4127-8d12-f75bd7662461 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1730 microversion: 2.1 time: 0.154560 Jun 24 23:53:27.908680 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 360/736] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:53:27 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:53:27.927410 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:27.927927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:27.934493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.934935 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.935690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.936122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.943859 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:27.944464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:27.950458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.950899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.951657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:27.952093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:27.967022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 HTTP/1.1 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:53:27.969282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:53:27.971068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'cb534158-a606-4d20-89de-2c7c5cbfa9a7'} Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:53:27.972039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:53:27.973468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:53:27.975152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:53:27.975152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-169548dd-4dbe-4555-87dc-dbb0797aa91b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 404 len: 111 microversion: 2.20 time: 0.030668 Jun 24 23:53:27.975152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 361/737] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:27 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 23:53:27.979445 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4105916f-5ef9-48cf-9057-dc761a5038bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '.version_select at 0x7f7a55a8f5e0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:28.002199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4105916f-5ef9-48cf-9057-dc761a5038bd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795092375" status: 204 len: 0 microversion: 2.20 time: 0.026513 Jun 24 23:53:28.002795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 362/738] 10.222.0.47 () {60 vars in 1258 bytes} [Fri Jun 24 23:53:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795092375 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 23:53:28.037381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6b892f34-a8a7-4e88-b185-35cf55748f68 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113880 Jun 24 23:53:28.038290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 377/739] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:53:27 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:28.711162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e953a21a-87d4-4238-9152-8ac6fc52f1e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: .version_select at 0x7f7a559f4310>, body: {"keypair": {"name": "tempest-keypair-1320671373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/wHcaiSDmHQpDYgUyJwd5lc9u62PeGclJe2g+2GElJAq8kO/SRXwsWbBlgknhtmHRHIaSO1z5A38DEK3dQ1F2POhp4hP3vO61btbt0vvakE0vK+wrp2faefu+XdA11fA=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:28.726271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e953a21a-87d4-4238-9152-8ac6fc52f1e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:53:28.730246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e953a21a-87d4-4238-9152-8ac6fc52f1e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for user 2e78cf97bac4484f93c7359b86a26628 and project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:53:28.753192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e953a21a-87d4-4238-9152-8ac6fc52f1e1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046127 Jun 24 23:53:28.754092 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 363/740] 10.222.0.47 () {62 vars in 1199 bytes} [Fri Jun 24 23:53:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 23:53:29.011437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-37b2e490-7acd-478a-830a-83b75875248e req-7bb856fd-f812-4ca3-93cc-ed976e6d99eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:29.025795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-37b2e490-7acd-478a-830a-83b75875248e req-7bb856fd-f812-4ca3-93cc-ed976e6d99eb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:29.026534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-37b2e490-7acd-478a-830a-83b75875248e req-7bb856fd-f812-4ca3-93cc-ed976e6d99eb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:29.043251 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-37b2e490-7acd-478a-830a-83b75875248e req-7bb856fd-f812-4ca3-93cc-ed976e6d99eb service nova] Creating event network-changed:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:53:29.049344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-37b2e490-7acd-478a-830a-83b75875248e req-7bb856fd-f812-4ca3-93cc-ed976e6d99eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044388 Jun 24 23:53:29.050062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 378/741] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:30.323597 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1210559588", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60e34007-a69c-47fc-8c00-8c9fc955fd1c"}], "security_groups": [{"name": "tempest-securitygroup--524377870"}], "key_name": "tempest-keypair-1320671373", "user_data": "}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:30.430347 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] validate_networks() for [('60e34007-a69c-47fc-8c00-8c9fc955fd1c', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:53:30.805138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:53:30.805569 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:53:30.806049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:53:30.806462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:53:30.806878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:53:30.816297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:30.816912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:30.817856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:30.818295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:30.836732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:53:30.840679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Getting quotas for user 2e78cf97bac4484f93c7359b86a26628 and project 5ccf88e235fa45d1b92c7c5612bfe140. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:53:30.852045 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:53:30.854755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:53:30.906545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f0161af1-929c-41bb-816f-2a94faa459fb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.587866 Jun 24 23:53:30.907180 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 364/742] 10.222.0.47 () {62 vars in 1187 bytes} [Fri Jun 24 23:53:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 23:53:30.918441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:30.919344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:31.066068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-6426dcd3-8b1e-47e2-a2dd-b08be00c780b req-d5e1800d-dcc6-46e6-8e0c-fd69075542c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:31.075041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-6426dcd3-8b1e-47e2-a2dd-b08be00c780b req-d5e1800d-dcc6-46e6-8e0c-fd69075542c5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:31.075719 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-6426dcd3-8b1e-47e2-a2dd-b08be00c780b req-d5e1800d-dcc6-46e6-8e0c-fd69075542c5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:31.088278 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-6426dcd3-8b1e-47e2-a2dd-b08be00c780b req-d5e1800d-dcc6-46e6-8e0c-fd69075542c5 service nova] Creating event network-changed:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:53:31.093634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-6426dcd3-8b1e-47e2-a2dd-b08be00c780b req-d5e1800d-dcc6-46e6-8e0c-fd69075542c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031761 Jun 24 23:53:31.094250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 365/743] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:31.188188 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:31.195954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:31.197787 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:31.198934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fbef5449-6714-45d3-a979-6ff745b2b0d7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1282 microversion: 2.20 time: 0.285372 Jun 24 23:53:31.199481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 379/744] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:30 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:32.224440 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:32.225174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:32.231518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:32.231973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:32.232777 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:32.233215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:32.305905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:32.315610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:32.317257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:32.318372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-672bded7-58b5-47e2-a186-9b7ba339e00a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1340 microversion: 2.20 time: 0.098703 Jun 24 23:53:32.318957 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 366/745] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:32 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:33.337485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:33.338098 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:33.346097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:33.346550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:33.347372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:33.347814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:33.491120 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:33.501344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:33.503331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:33.504526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bcf6cf65-c332-4dac-9dcc-dcc2c128f2d3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.171068 Jun 24 23:53:33.505177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 380/746] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:33 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:33.671856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-5e5958de-1a83-4379-bc41-1080c69470b3 req-5e87c62e-5b87-4a30-b682-94a625680dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:33.681737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5e5958de-1a83-4379-bc41-1080c69470b3 req-5e87c62e-5b87-4a30-b682-94a625680dc3 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:33.682431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-5e5958de-1a83-4379-bc41-1080c69470b3 req-5e87c62e-5b87-4a30-b682-94a625680dc3 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:33.689331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:33.699473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-5e5958de-1a83-4379-bc41-1080c69470b3 req-5e87c62e-5b87-4a30-b682-94a625680dc3 service nova] Creating event network-changed:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:53:33.707693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-5e5958de-1a83-4379-bc41-1080c69470b3 req-5e87c62e-5b87-4a30-b682-94a625680dc3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039761 Jun 24 23:53:33.708792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 367/747] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:34.522749 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:34.523266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:34.529785 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:34.530239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:34.531639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:34.532078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:34.663810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:34.672476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:34.674037 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:34.675141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7be706fb-071d-42e9-9301-97eecda9d454 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.156650 Jun 24 23:53:34.675688 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 381/748] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:34 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:35.704086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:35.704828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:35.712183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:35.712654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:35.714196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:35.714642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:35.951139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:35.959042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:35.960546 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:35.961691 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9580be88-79e5-42ae-a319-58d7b0d6fbcf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.271207 Jun 24 23:53:35.962407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 368/749] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:35 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:36.979546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:36.980154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:36.987551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:36.988004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:36.988808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:36.989247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:37.121817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:37.130241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:37.131803 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:37.133361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a7a95adf-40db-47ca-ad67-2baf1e0abcb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.157503 Jun 24 23:53:37.138078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 382/750] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:36 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:38.152396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:38.153125 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:38.161869 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:38.162621 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:38.163695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:38.164121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:38.389641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:38.397856 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:38.399350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:38.400564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a051196b-95f0-42fc-a498-ae1f1d8e894b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.252887 Jun 24 23:53:38.401139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 369/751] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:38 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:39.418245 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:39.418822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:39.421980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=78 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:39.427552 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:39.427997 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:39.428800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:39.429228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:39.596798 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:39.605158 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:39.606870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:39.607986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-464aac88-1b87-43ba-9538-e831e85658ff tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.193528 Jun 24 23:53:39.609845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 383/752] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:39 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:39.721975 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-19b9101b-6426-44c4-9127-ee7d69105369 req-cac9760e-fb79-4638-9997-9917a75bd953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "name": "network-vif-plugged", "status": "completed", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:39.734300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-19b9101b-6426-44c4-9127-ee7d69105369 req-cac9760e-fb79-4638-9997-9917a75bd953 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:39.734912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-19b9101b-6426-44c4-9127-ee7d69105369 req-cac9760e-fb79-4638-9997-9917a75bd953 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:39.750461 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-19b9101b-6426-44c4-9127-ee7d69105369 req-cac9760e-fb79-4638-9997-9917a75bd953 service nova] Creating event network-vif-plugged:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:53:39.756564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-19b9101b-6426-44c4-9127-ee7d69105369 req-cac9760e-fb79-4638-9997-9917a75bd953 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039843 Jun 24 23:53:39.757209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 370/753] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:40.627963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:40.628668 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:40.635018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:40.635461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:40.636214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:40.636666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:40.772972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:40.780752 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:40.782287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:40.783392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5853cf73-8ef0-47f4-9b75-ae7a63045bb3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.159897 Jun 24 23:53:40.783943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 384/754] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:40 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:41.799155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:41.800350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=10 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:41.805322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:41.806017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:41.808948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:41.815313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:41.815822 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:41.816773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:41.817194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:41.954130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:41.962101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:41.963762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:41.965063 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6fffb9b2-35b7-4191-b22a-69a4669199dd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1407 microversion: 2.20 time: 0.167325 Jun 24 23:53:41.965610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 371/755] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:41 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:53:42.984279 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:42.984808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:42.986768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:53:42.992733 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:42.993180 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:42.993934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:42.994395 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:43.129034 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:43.136933 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:43.138476 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:53:43.140658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-150f42f9-0fe0-43ac-8c21-891876bb20ae tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1599 microversion: 2.20 time: 0.160255 Jun 24 23:53:43.141221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 385/756] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:53:42 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:53:43.158763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:53:43.159259 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:53:43.165733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:43.166184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:43.166954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:43.167392 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:43.271018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-44875761-3536-433d-b4e9-19045233b4cc tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116831 Jun 24 23:53:43.271758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 372/757] 10.222.0.47 () {60 vars in 1315 bytes} [Fri Jun 24 23:53:43 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:53:44.452122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-f49ab372-df26-40c2-8375-d6d09ef948a1 req-6786da53-4436-4acb-9d9a-905b97c58c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:53:44.461401 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f49ab372-df26-40c2-8375-d6d09ef948a1 req-6786da53-4436-4acb-9d9a-905b97c58c80 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:53:44.461844 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f49ab372-df26-40c2-8375-d6d09ef948a1 req-6786da53-4436-4acb-9d9a-905b97c58c80 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:53:44.473385 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-f49ab372-df26-40c2-8375-d6d09ef948a1 req-6786da53-4436-4acb-9d9a-905b97c58c80 service nova] Creating event network-changed:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:53:44.478646 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-f49ab372-df26-40c2-8375-d6d09ef948a1 req-6786da53-4436-4acb-9d9a-905b97c58c80 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030463 Jun 24 23:53:44.479254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 386/758] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:53:57.211288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 23:53:57.211969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Fri Jun 24 23:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 23:54:04.199485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:04.200235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=25 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:04.204555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:04.205507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:04.212325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.212750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.213553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.213993 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.242731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c0bcf978-da8c-49d9-b039-9e600506cbae tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044658 Jun 24 23:54:04.243279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 373/759] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:04 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:54:04.298845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=7 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:04.299608 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=56 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:04.303809 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:04.304396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:04.312215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.313041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.314206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.314654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.339770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:54:04.415518 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ee943065-3e49-45fd-894a-96252d1fc28b tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 204 len: 0 microversion: 2.1 time: 0.117960 Jun 24 23:54:04.416449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 387/760] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:54:04 2022] DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:54:04.425818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:04.426452 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:04.432373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.432858 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.433626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:04.434066 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:04.562135 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:04.569571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c02b0695-bc5d-4239-b85f-a7a0aa4de1bb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1671 microversion: 2.1 time: 0.148041 Jun 24 23:54:04.570154 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 374/761] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:04 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:05.595391 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:05.596092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:05.604101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:05.604555 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:05.605360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:05.606003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:05.741386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:05.749276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2890f765-fb2e-4c1f-a6f1-53eca07cb85d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1671 microversion: 2.1 time: 0.159047 Jun 24 23:54:05.749887 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 388/762] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:05 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:06.767523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:06.768149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:06.774939 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:06.775391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:06.776170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:06.776634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:07.037432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:07.045059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2c707d7d-1fcc-4a19-8fcd-1ee2540b76d7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 200 len: 1671 microversion: 2.1 time: 0.281525 Jun 24 23:54:07.046153 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 375/763] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:06 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:07.500447 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-95a04aa3-92d2-442a-a9fe-3e9f6d49f065 req-5deceee3-4c67-4c74-8a82-af33f2ac7268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5", "name": "network-vif-deleted", "tag": "a24eac32-170f-4a97-ad18-9d87820319c1"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:07.513884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-95a04aa3-92d2-442a-a9fe-3e9f6d49f065 req-5deceee3-4c67-4c74-8a82-af33f2ac7268 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:07.514559 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-95a04aa3-92d2-442a-a9fe-3e9f6d49f065 req-5deceee3-4c67-4c74-8a82-af33f2ac7268 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:07.529036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-95a04aa3-92d2-442a-a9fe-3e9f6d49f065 req-5deceee3-4c67-4c74-8a82-af33f2ac7268 service nova] Creating event network-vif-deleted:a24eac32-170f-4a97-ad18-9d87820319c1 for instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 on hv-cinder-84762 Jun 24 23:54:07.534740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-95a04aa3-92d2-442a-a9fe-3e9f6d49f065 req-5deceee3-4c67-4c74-8a82-af33f2ac7268 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038429 Jun 24 23:54:07.535445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 389/764] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:08.063540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.065446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.075430 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.075887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.076802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.077317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.095247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 HTTP/1.1 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:08.097006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:54:08.098362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5'} Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:08.099681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:54:08.102343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:08.103697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:08.103697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-59157543-8724-4858-b27f-ede148a2cef4 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 404 len: 111 microversion: 2.1 time: 0.039855 Jun 24 23:54:08.103697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 376/765] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:08 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:54:08.107106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cdad42fd-bcba-427c-af2a-39e5b7773473 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '.version_select at 0x7f7a55a04af0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.127413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cdad42fd-bcba-427c-af2a-39e5b7773473 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536309712" status: 202 len: 0 microversion: 2.1 time: 0.023895 Jun 24 23:54:08.128624 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 377/766] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Jun 24 23:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536309712 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:08.313875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.314470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.322284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.325205 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.327064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.327548 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.363174 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0f41c941-6088-44b4-9aa8-8a6f2f313cbb tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/ips" status: 200 len: 150 microversion: 2.1 time: 0.290639 Jun 24 23:54:08.369674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 390/767] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:54:08 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/ips => generated 150 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:08.396848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:08.397395 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.404059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.405119 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.405917 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.406379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.432426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.436948 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.448968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.450026 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.450698 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lazy-loading 'flavor' on Instance uuid e5435298-6b0b-457c-bdb7-be68874c9e86 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:08.451238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.452398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.572009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-780047d3-e00f-40b5-b4c4-a306dfd7da6f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "POST /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86/action" status: 202 len: 0 microversion: 2.1 time: 0.177976 Jun 24 23:54:08.573988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 378/768] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:54:08 2022] POST /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:08.583526 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.584634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.595132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.595603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.598441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.598836 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.622098 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'services' on Instance uuid 43b00699-41e7-46ea-b9a6-6968cdb016df {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:08.783932 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c79f91be-7632-4053-82be-2a6e69cfd40b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments/1a8603bd-aacd-48cb-9f24-67ee373ba6ea" status: 202 len: 0 microversion: 2.1 time: 0.357480 Jun 24 23:54:08.785064 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 391/769] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:54:08 2022] DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments/1a8603bd-aacd-48cb-9f24-67ee373ba6ea => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:08.809779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:08.812090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:08.822891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.823381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.824202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:08.824660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:08.876946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fef1fd45-1e06-4af9-b91f-2cec1d7dd4a6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086725 Jun 24 23:54:08.878023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 392/770] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:08 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:08.920251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:08.926964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-90f66fc9-df50-455d-8530-bf0344f4d310 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.348672 Jun 24 23:54:08.927706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 379/771] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:08 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:08.943655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d678825a-a67a-4369-9cbf-0b6a4823ffa2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: .version_select at 0x7f7a55ada9d0>, body: {"keypair": {"name": "tempest-keypair-2018124302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDYtD7vT21Y5z028XmGaVaVLTAw73e2KnEWKF82VMdfHlxy7qJ7SyJ0ykj3odqGoCK/XJWUvvnfJm8IgxVfLDWPaea4J01T5L1Pj+GmVwddnBi6bVGh4qfA1RyXv3ewrw=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:08.958067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-d678825a-a67a-4369-9cbf-0b6a4823ffa2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for project a779b000010c4549989d8a8f25e8b1be. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:54:08.962263 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-d678825a-a67a-4369-9cbf-0b6a4823ffa2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for user 927ffbcd7078473f97f42bdb54acf57e and project a779b000010c4549989d8a8f25e8b1be. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:54:08.984129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d678825a-a67a-4369-9cbf-0b6a4823ffa2 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044347 Jun 24 23:54:08.984737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 393/772] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:54:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:09.831843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a656671-8b5a-45d0-b7ee-5dcbeb54d461"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:09.832984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:09.839393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.839838 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:09.840604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.841062 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:09.890513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:09.891517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:09.898856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.899569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:09.900425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.900952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:09.930232 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-46eb0ac5-f1ef-4656-9852-a78c4cd508f2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044240 Jun 24 23:54:09.935243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 394/773] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:09 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:54:09.949896 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:09.950521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:09.964572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.965017 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:09.965788 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:09.966238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.119580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:10.127832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-23a2c967-575a-4212-9ac1-c5796189ea29 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.181682 Jun 24 23:54:10.128387 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 395/774] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:09 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:10.133639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:10.134357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:10.142072 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.142522 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.143443 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.143883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.147804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a2982d59-dcef-47fa-8795-5b3981c1c4dd tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319909 Jun 24 23:54:10.149747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 380/775] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:54:09 2022] POST /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:10.174249 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:54:10.275691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e81ed6e0-a7b9-422e-ba3a-9d22dfa85282 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 204 len: 0 microversion: 2.1 time: 0.145754 Jun 24 23:54:10.276325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 396/776] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:54:10 2022] DELETE /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:54:10.286363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:10.289353 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:10.297193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.297740 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.298603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.299117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.329187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1897279438", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f87168d-b987-4697-a560-81cade710588"}], "security_groups": [{"name": "tempest-securitygroup--1974508924"}], "key_name": "tempest-keypair-2018124302", "user_data": "}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:10.435951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.network.neutron [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] validate_networks() for [('3f87168d-b987-4697-a560-81cade710588', None, None, None, None, None)] {{(pid=124092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:54:10.437017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:10.444559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-55a1a95a-4bbf-456a-801f-d24fa68f77be tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1690 microversion: 2.1 time: 0.162830 Jun 24 23:54:10.445147 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 381/777] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:10 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:10.898282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Flavor limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:54:10.898760 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Image limits 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:54:10.899167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Flavor pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:54:10.899574 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Image pref 0:0:0 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:54:10.899985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.virt.hardware [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:54:10.909397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.909788 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.910595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:10.911344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:10.929887 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for project a779b000010c4549989d8a8f25e8b1be. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:54:10.934033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Getting quotas for user 927ffbcd7078473f97f42bdb54acf57e and project a779b000010c4549989d8a8f25e8b1be. Resources: {'ram', 'cores', 'instances'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:54:10.945562 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Going to run 1 instances... {{(pid=124092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:54:10.947948 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:54:10.994911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cb020a7f-d205-4d48-b0bf-dc9d9eeb7448 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.670566 Jun 24 23:54:10.995543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 397/778] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:54:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:54:11.006306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a66d830d-6c62-45e9-bb75-ed201c50b734 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:11.006992 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a66d830d-6c62-45e9-bb75-ed201c50b734 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:11.059281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a66d830d-6c62-45e9-bb75-ed201c50b734 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:11.066795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a66d830d-6c62-45e9-bb75-ed201c50b734 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1238 microversion: 2.1 time: 0.064485 Jun 24 23:54:11.067528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 382/779] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:11 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:11.146212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:11.146835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:11.154783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:11.155229 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:11.155979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:11.156407 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:11.302412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:11.311097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-90052e11-4a79-4342-98bd-58f4c6ca4dc7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.168401 Jun 24 23:54:11.311824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 398/780] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:11 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:11.462630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:11.463400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:11.470227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:11.470676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:11.471436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:11.472283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:11.616045 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:11.624195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-75531a06-83ec-4aa5-9049-a8f5af51f192 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1690 microversion: 2.1 time: 0.165670 Jun 24 23:54:11.624875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 383/781] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:11 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:12.083147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:12.083762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:12.090138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.090587 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.091347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.092363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.152429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:12.160346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a470e1b6-2102-4412-93e2-4f9da4cc17a7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1242 microversion: 2.1 time: 0.081064 Jun 24 23:54:12.160939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 399/782] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:12 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:12.329800 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:12.330432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:12.336355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.336834 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.337589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.338020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.470250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:12.477735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a10ddf9a-3aa5-41c4-b94a-ce513696ec4d tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.152664 Jun 24 23:54:12.478297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 384/783] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:12 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:12.641486 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:12.642094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:12.648304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.648789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.649551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:12.649986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:12.775558 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:12.782967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5f821a9d-d83d-4dfb-8c0b-3a602d477125 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1690 microversion: 2.1 time: 0.145900 Jun 24 23:54:12.783526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 400/784] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:12 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:13.177267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:13.177880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:13.184961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.186295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.187369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.187810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.249498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:13.257768 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-661c883f-bede-4155-89f7-bceb3d005df0 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1242 microversion: 2.1 time: 0.084368 Jun 24 23:54:13.258320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 385/785] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:13 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:13.494697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:13.495318 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:13.502090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.502471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.503225 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.503683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.639715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:13.647282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-284d5dc7-a617-4dac-9c85-2f29bfe17971 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.156520 Jun 24 23:54:13.647835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 401/786] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:13 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:13.800155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:13.800775 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:13.806880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.807323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.808852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:13.809333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:13.955463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:13.963046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-334440a8-5e34-4ede-9c1c-a6fe3e4b3cf2 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1690 microversion: 2.1 time: 0.167540 Jun 24 23:54:13.963604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 386/787] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:13 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:14.275103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:14.275866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:14.282379 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.282838 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:14.284046 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.284046 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:14.290252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:14.354952 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:14.363761 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4a5cabd9-4b1a-4a3c-87ce-63dc8aa8d062 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1308 microversion: 2.1 time: 0.092610 Jun 24 23:54:14.364352 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 402/788] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:14 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:14.664283 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:14.664934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:14.672905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.673361 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:14.674137 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.674579 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:14.980487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:14.981061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:14.988413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.989186 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:14.990012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:14.990455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:15.031507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:15.040841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-637c2791-9a99-4e4c-ad47-c74af1f809ef tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.380334 Jun 24 23:54:15.041610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 387/789] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:14 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:15.124366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:15.132272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b9c82b47-3062-49f4-91d7-83e4265dc18c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1690 microversion: 2.1 time: 0.155687 Jun 24 23:54:15.132871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 403/790] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:14 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:15.381634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:15.382380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:15.388366 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:15.389498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:15.390286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:15.390726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:15.484239 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:15.488108 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:15.499875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-72a39855-8624-47cf-a59d-615106baa258 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1296 microversion: 2.1 time: 0.115154 Jun 24 23:54:15.499875 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 388/791] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:15 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:15.829460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-485703e9-66ef-479a-9e56-e53f81956b03 req-785de513-55bc-4bfb-8f16-edf1389c77a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b00699-41e7-46ea-b9a6-6968cdb016df", "name": "network-vif-deleted", "tag": "65de1855-8fd3-4be1-8503-4e5247f1de33"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:15.845327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-485703e9-66ef-479a-9e56-e53f81956b03 req-785de513-55bc-4bfb-8f16-edf1389c77a8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:15.849253 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-485703e9-66ef-479a-9e56-e53f81956b03 req-785de513-55bc-4bfb-8f16-edf1389c77a8 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:15.869977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-485703e9-66ef-479a-9e56-e53f81956b03 req-785de513-55bc-4bfb-8f16-edf1389c77a8 service nova] Creating event network-vif-deleted:65de1855-8fd3-4be1-8503-4e5247f1de33 for instance 43b00699-41e7-46ea-b9a6-6968cdb016df on hv-cinder-84762 Jun 24 23:54:15.877343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-485703e9-66ef-479a-9e56-e53f81956b03 req-785de513-55bc-4bfb-8f16-edf1389c77a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131918 Jun 24 23:54:15.878641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 404/792] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:16.058457 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:16.059067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:16.074465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.075036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.076765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.077636 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.152154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:16.153662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:16.161207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.161647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.162406 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.162995 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.197929 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.198690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.199346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'fault' on Instance uuid 43b00699-41e7-46ea-b9a6-6968cdb016df {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:16.287714 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:16.305721 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d01e95f9-1560-4349-a0f5-e0e2f962e7d6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 200 len: 1336 microversion: 2.1 time: 0.158161 Jun 24 23:54:16.307297 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 405/793] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:16 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 1336 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:16.342056 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:16.354994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-88008300-583c-4330-8cb4-82fd5cff6809 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.300244 Jun 24 23:54:16.355840 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 389/794] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:16 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:16.509670 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:16.510284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:16.528287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.529106 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.530067 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:16.531023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:16.709770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:16.721005 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0066de31-2810-4062-af7f-c0e8ac3fe637 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.213708 Jun 24 23:54:16.722040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 406/795] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:16 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:17.325177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:17.325791 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 43b00699-41e7-46ea-b9a6-6968cdb016df] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:17.332505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.332994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.333763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.334204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.349867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] HTTP exception thrown: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Request method failure captured: Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df HTTP/1.1 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1cBwVNNAxzE76WSZ8Z5p_LLGlX35aLEOjd_VyWHbkJiifV0IDEEgVkGvKSSQxP0JG63sFpYFnpscPv3x-NCeF5U4Rxs6iWTIElzw7WhF4qXW-Dh_TiZCRupUIRCRz_IIRhQuZqTHn5KIp0cMPM7pBr19m2AP0RUpt7rv7TP66P5FE Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:17.351479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}] Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 5eb7e8b4befd4d519b440c632b59e724 Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. Jun 24 23:54:17.353047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '43b00699-41e7-46ea-b9a6-6968cdb016df'} Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:17.353861 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. Jun 24 23:54:17.355279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:17.356843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Returning 404 to user: Instance 43b00699-41e7-46ea-b9a6-6968cdb016df could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:17.356843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a4a128cf-2de7-4ce7-9197-c17792f38e44 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df" status: 404 len: 111 microversion: 2.1 time: 0.032438 Jun 24 23:54:17.356843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 390/796] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:17 2022] GET /compute/v2.1/servers/43b00699-41e7-46ea-b9a6-6968cdb016df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:54:17.362223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-da7717e7-a172-4114-b7c1-ea70ca8c43b1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '.version_select at 0x7f7a55ad1430>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:17.372974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:17.373601 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:17.379974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.380287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-da7717e7-a172-4114-b7c1-ea70ca8c43b1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039477784" status: 202 len: 0 microversion: 2.1 time: 0.021847 Jun 24 23:54:17.380410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.381229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.381699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.384827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 407/797] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Jun 24 23:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039477784 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:17.582029 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:17.591117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-db73bb90-3680-47dd-8b98-7d2b74a20942 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.221859 Jun 24 23:54:17.595758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 391/798] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:17 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:17.739906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:17.740518 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:17.746855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.747314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.748769 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.749209 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.900533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-c47f6337-66ca-40e1-85a8-355f231d3e8e req-bcb3ac43-6be9-47d9-8455-cd50c9758356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344f8883-ac33-4013-ac55-df97655fdf1a", "tag": "9456be43-2212-4cd8-972c-5adfd0a88919"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:17.908929 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-c47f6337-66ca-40e1-85a8-355f231d3e8e req-bcb3ac43-6be9-47d9-8455-cd50c9758356 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:17.909375 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-c47f6337-66ca-40e1-85a8-355f231d3e8e req-bcb3ac43-6be9-47d9-8455-cd50c9758356 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:17.920689 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-c47f6337-66ca-40e1-85a8-355f231d3e8e req-bcb3ac43-6be9-47d9-8455-cd50c9758356 service nova] Creating event network-changed:9456be43-2212-4cd8-972c-5adfd0a88919 for instance 344f8883-ac33-4013-ac55-df97655fdf1a on hv-cinder-84762 Jun 24 23:54:17.925650 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-c47f6337-66ca-40e1-85a8-355f231d3e8e req-bcb3ac43-6be9-47d9-8455-cd50c9758356 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028850 Jun 24 23:54:17.926226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 392/799] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:17.966193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:17.974102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a765843c-13d2-4cbc-a147-cf54ce08fc88 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.239967 Jun 24 23:54:17.974668 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 408/800] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:17 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:18.616412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:18.617151 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:18.624755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:18.625217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:18.625982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:18.626420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:18.814829 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:18.822290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-34c8320f-178c-4ddd-b1a4-931b7c2de9b2 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.210673 Jun 24 23:54:18.822847 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 393/801] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:18 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:18.991029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:18.991636 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:18.998842 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:18.999199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:18.999955 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:19.000380 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:19.129285 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:19.136696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-36af42dd-dd93-490f-a25f-f48a2c777e00 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.149545 Jun 24 23:54:19.137261 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 409/802] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:18 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:19.826752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a656671-8b5a-45d0-b7ee-5dcbeb54d461"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:19.827864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:19.834317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:19.834764 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:19.835538 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:19.835970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:19.840132 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:19.840867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:19.847228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:19.847766 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:19.848819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:19.849330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:19.931563 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: POST /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments HTTP/1.1 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 74 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:19.934215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {"volumeAttachment": {"volumeId": "8a656671-8b5a-45d0-b7ee-5dcbeb54d461"}} Jun 24 23:54:19.936402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'server_id': 'dc6825b3-9d28-448f-a8bd-7580e4da3246', 'body': {'volumeAttachment': {'volumeId': '8a656671-8b5a-45d0-b7ee-5dcbeb54d461'}}} Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:19.937318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:19.938741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:19.940187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:19.940187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:19.940187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:19.940187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 Jun 24 23:54:19.940187 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:19.942431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 400 to user: Invalid volume: volume 8a656671-8b5a-45d0-b7ee-5dcbeb54d461 is already attached to instances: dc6825b3-9d28-448f-a8bd-7580e4da3246 {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:19.943527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cbb98d73-f531-41cc-bf01-f5f2f8070ae0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121362 Jun 24 23:54:19.944868 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 394/803] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:54:19 2022] POST /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:54:20.008660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:20.018880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:20.019733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:20.026914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c9ec183e-3132-4834-b00e-eca374f69ec4 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.190539 Jun 24 23:54:20.027498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 410/804] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:19 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:20.031473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.031923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.032940 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.033389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.118357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'services' on Instance uuid dc6825b3-9d28-448f-a8bd-7580e4da3246 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:20.153840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:20.154551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:20.160843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.161302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.162139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.162581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.196850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-434735ca-0753-498f-bb8e-ae6301af4b17 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments/8a656671-8b5a-45d0-b7ee-5dcbeb54d461" status: 202 len: 0 microversion: 2.1 time: 0.181879 Jun 24 23:54:20.197438 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 395/805] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:54:20 2022] DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments/8a656671-8b5a-45d0-b7ee-5dcbeb54d461 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:20.207149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:20.208212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:20.214802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.215260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.216027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.216979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.246631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-871c91e9-1713-4943-a9ef-f81d298f27c7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043501 Jun 24 23:54:20.247184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 396/806] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:20 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:20.298357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:20.305774 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-af3542fd-cd9b-44bd-88ab-cbf6a3782169 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.155900 Jun 24 23:54:20.306365 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 411/807] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:20 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:20.408130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:20.408641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:20.414557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.415068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.415831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.416261 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.441150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:54:20.520394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6d5c467b-3029-42f6-be38-26d33908f1ef tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 204 len: 0 microversion: 2.1 time: 0.116503 Jun 24 23:54:20.521370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 397/808] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:54:20 2022] DELETE /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:54:20.531340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:20.531954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:20.537886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.538330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.539101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:20.539536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:20.669765 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:20.677315 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-793ef1f0-5ce2-4332-b52e-ebc3d9ba3df1 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1507 microversion: 2.1 time: 0.151961 Jun 24 23:54:20.677881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 412/809] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:20 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:21.045473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:21.046722 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:21.053239 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.053690 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.054458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.054924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.072995 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:21.195605 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:21.204936 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-15395045-dbb0-4dc8-bee8-4838df979297 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.163688 Jun 24 23:54:21.205492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 398/810] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:21 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:21.259303 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:21.260287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:21.262264 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:21.262946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=10 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:21.269820 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.270272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.271048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.271488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.308399 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a419f262-7851-4e6a-9752-c21af63a2758 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052705 Jun 24 23:54:21.308834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 413/811] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:21 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:21.326408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:21.327024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:21.333037 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.333517 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.334285 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.334720 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.463090 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:21.470930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-022c9b01-0287-488b-8f00-02381737128a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.151609 Jun 24 23:54:21.471480 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 399/812] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:21 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:21.694388 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:21.695025 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:21.701542 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.702000 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.702759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.703194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.839821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:21.847806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9f2f0393-81b2-41ab-a86a-f7b9f72006d7 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1507 microversion: 2.1 time: 0.157365 Jun 24 23:54:21.848361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 414/813] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:21 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:21.939349 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-88e1fae7-c008-46bc-ae7d-6bb71f88c33d req-c6a9893f-bf47-4996-9494-9ea2b265d30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344f8883-ac33-4013-ac55-df97655fdf1a", "name": "network-vif-plugged", "status": "completed", "tag": "9456be43-2212-4cd8-972c-5adfd0a88919"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:21.947769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-88e1fae7-c008-46bc-ae7d-6bb71f88c33d req-c6a9893f-bf47-4996-9494-9ea2b265d30a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:21.948205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-88e1fae7-c008-46bc-ae7d-6bb71f88c33d req-c6a9893f-bf47-4996-9494-9ea2b265d30a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:21.959997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-88e1fae7-c008-46bc-ae7d-6bb71f88c33d req-c6a9893f-bf47-4996-9494-9ea2b265d30a service nova] Creating event network-vif-plugged:9456be43-2212-4cd8-972c-5adfd0a88919 for instance 344f8883-ac33-4013-ac55-df97655fdf1a on hv-cinder-84762 Jun 24 23:54:21.965088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-88e1fae7-c008-46bc-ae7d-6bb71f88c33d req-c6a9893f-bf47-4996-9494-9ea2b265d30a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094937 Jun 24 23:54:21.965662 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 400/814] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:22.222477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:22.223089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:22.225998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:22.229944 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.230394 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.231155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.231583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.321537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:22.322545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:22.330146 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.330591 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.331363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.331795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.360571 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c68b9e0e-f6ec-4115-9879-688cfb6adee7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Jun 24 23:54:22.361145 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 401/815] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:22 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:22.367122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:22.375628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4fa18798-4758-4b6e-a91f-c86c33c0f492 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.156959 Jun 24 23:54:22.376191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 415/816] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:22 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:22.487407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:22.487962 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:22.493974 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.494429 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.495196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.495633 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.624553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:22.632176 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b4f7f2f3-cfda-45d4-8c39-eb0403173c98 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.148696 Jun 24 23:54:22.632772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 402/817] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:22 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:22.864190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:22.864826 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:22.871088 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.871538 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:22.872298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:22.873560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.025130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:23.033016 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c1471c8d-7520-4ff7-b1c3-c03f17c24f07 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1507 microversion: 2.1 time: 0.172616 Jun 24 23:54:23.033572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 416/818] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:22 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:23.372716 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:23.373651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:23.380409 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.380923 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.381707 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.382145 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.394133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:23.395184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:23.408756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.409235 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.411276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.411735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.416159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-13c0ba0c-116d-4bfe-afd5-9f3c10f56de3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048513 Jun 24 23:54:23.427031 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 403/819] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:23 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:23.561604 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:23.569259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6c745c1a-6944-453e-aba6-bb01423c5829 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.181013 Jun 24 23:54:23.579308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 417/820] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:23 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:23.651074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:23.651687 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:23.658250 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.658699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:23.659459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:23.660066 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.050322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.050959 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.057338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.057882 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.058759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.059276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.121746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:24.128357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:24.129990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9c44155b-1f60-461d-8abe-ec63b80ead6a tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1465 microversion: 2.1 time: 0.083747 Jun 24 23:54:24.130781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 418/821] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:24 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1465 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:24.136144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-65fb239d-1fd2-4cc9-ae42-b90f1cb7fe50 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1364 microversion: 2.1 time: 0.488909 Jun 24 23:54:24.136943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 404/822] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:23 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:24.204603 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-39c3803d-726a-4596-95a1-b8f265105980 req-d4dbab88-0013-4980-9737-84063990886e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6babba1a-e4d5-4053-90c2-d201309bd0db", "name": "network-vif-deleted", "tag": "96388227-d615-4437-9d96-2d65e2ebf656"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:24.212913 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-39c3803d-726a-4596-95a1-b8f265105980 req-d4dbab88-0013-4980-9737-84063990886e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.213358 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-39c3803d-726a-4596-95a1-b8f265105980 req-d4dbab88-0013-4980-9737-84063990886e service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.225357 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-39c3803d-726a-4596-95a1-b8f265105980 req-d4dbab88-0013-4980-9737-84063990886e service nova] Creating event network-vif-deleted:96388227-d615-4437-9d96-2d65e2ebf656 for instance 6babba1a-e4d5-4053-90c2-d201309bd0db on hv-cinder-84762 Jun 24 23:54:24.230709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-39c3803d-726a-4596-95a1-b8f265105980 req-d4dbab88-0013-4980-9737-84063990886e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Jun 24 23:54:24.231337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 419/823] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:24.429276 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.430138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.437265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.437727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.438484 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.438921 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.442602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:24.470660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c369e5d1-1cb0-44d9-a822-58d7cecb554d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046014 Jun 24 23:54:24.471357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 405/824] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:54:24 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 23:54:24.531800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.532411 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.538758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.539204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.539975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.540406 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.567618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:54:24.570887 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:24.587037 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.587792 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.600061 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.600632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.601491 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.609018 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.659849 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1fe12308-e00c-479b-aaf1-8446102a3cca tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 204 len: 0 microversion: 2.1 time: 0.132801 Jun 24 23:54:24.660437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 420/825] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:54:24 2022] DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:54:24.669102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.671165 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.678485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.679493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.680875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.681655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.792142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:24.801088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-727f983b-9703-4a1b-a178-fbddcc269f41 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1571 microversion: 2.1 time: 0.217910 Jun 24 23:54:24.801753 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 406/826] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:24 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1571 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:24.817343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:24.817913 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.823844 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.824291 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.825098 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.825578 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.832118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:24.839509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-56c25323-6057-4d30-8af1-b3dbe6f56e10 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1683 microversion: 2.1 time: 0.174590 Jun 24 23:54:24.840002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 421/827] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:24 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:24.961864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a86d08aa-e280-4ac2-b16d-689aca74ab63 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "POST /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86/action" status: 202 len: 0 microversion: 2.1 time: 0.148150 Jun 24 23:54:24.962476 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 407/828] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:54:24 2022] POST /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:54:24.971293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:24.971900 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:24.977775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.978215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:24.978964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:24.979392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.148412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:25.148412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:25.154618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.155076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.155849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.156287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.173398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:25.182575 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9bbc818f-2bb6-43dc-832e-235aaf6b13a3 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1519 microversion: 2.1 time: 0.214908 Jun 24 23:54:25.183485 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 422/829] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:24 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:25.196998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:25.197234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.197613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:25.197721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.198134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'fault' on Instance uuid 6babba1a-e4d5-4053-90c2-d201309bd0db {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:25.205427 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.205878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.206965 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.207146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.244927 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:25.253682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-aa26bd5f-1e99-4a5a-84b6-d1ae0c690b5c tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1312 microversion: 2.1 time: 0.110303 Jun 24 23:54:25.254346 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 408/830] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:25 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:25.347725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:25.355841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-339f5c0d-5e23-41bd-b332-c32847379880 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1550 microversion: 2.1 time: 0.162452 Jun 24 23:54:25.356344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 423/831] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:25 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1550 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:25.372220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:25.373595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:25.380122 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.380569 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.381374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.381813 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.461586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0ee6548b-a553-4802-bb1c-79fd38baaa20 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093154 Jun 24 23:54:25.468464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 409/832] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:54:25 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:25.844398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-6eb17257-6c22-4886-ae61-4ff670088969 req-9b4976da-a9b9-4a61-be3f-28665ea23858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "name": "network-vif-unplugged", "status": "completed", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:25.858287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:25.859038 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:25.865382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-6eb17257-6c22-4886-ae61-4ff670088969 req-9b4976da-a9b9-4a61-be3f-28665ea23858 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.869702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.870284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-6eb17257-6c22-4886-ae61-4ff670088969 req-9b4976da-a9b9-4a61-be3f-28665ea23858 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.875370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.876425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:25.877258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:25.888821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.compute.server_external_events [req-6eb17257-6c22-4886-ae61-4ff670088969 req-9b4976da-a9b9-4a61-be3f-28665ea23858 service nova] Unable to find a host for instance e5435298-6b0b-457c-bdb7-be68874c9e86. Dropping event network-vif-unplugged {{(pid=124092) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 23:54:25.889716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-6eb17257-6c22-4886-ae61-4ff670088969 req-9b4976da-a9b9-4a61-be3f-28665ea23858 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049966 Jun 24 23:54:25.890455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 424/833] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 23:54:26.031088 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:26.038738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fa6a6d84-2166-441f-ae24-363c946ad75c tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1683 microversion: 2.1 time: 0.185622 Jun 24 23:54:26.039298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 410/834] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:25 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:26.199267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:26.199883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:26.206519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.206966 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.207726 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.208162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.271359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:26.271881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:26.277814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.278259 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.279093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.279523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.311924 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.312371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.312853 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lazy-loading 'fault' on Instance uuid 6babba1a-e4d5-4053-90c2-d201309bd0db {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:26.353533 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:26.361412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1b89eee6-92f8-4e6f-bd60-60756cc75ec6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 200 len: 1312 microversion: 2.1 time: 0.094201 Jun 24 23:54:26.361976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 411/835] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:26 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:26.659763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:26.667226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-69b3427b-5da7-4a1c-8e44-a2800791c0d6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1519 microversion: 2.1 time: 0.471801 Jun 24 23:54:26.667793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 425/836] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:26 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1519 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:26.788339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-dbf29955-33de-4948-832f-8e35cb49412b req-d2f34872-1f0d-4678-8211-53cabb174acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344f8883-ac33-4013-ac55-df97655fdf1a", "tag": "9456be43-2212-4cd8-972c-5adfd0a88919"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:26.798382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-dbf29955-33de-4948-832f-8e35cb49412b req-d2f34872-1f0d-4678-8211-53cabb174acb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:26.798825 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-dbf29955-33de-4948-832f-8e35cb49412b req-d2f34872-1f0d-4678-8211-53cabb174acb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:26.811190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-dbf29955-33de-4948-832f-8e35cb49412b req-d2f34872-1f0d-4678-8211-53cabb174acb service nova] Creating event network-changed:9456be43-2212-4cd8-972c-5adfd0a88919 for instance 344f8883-ac33-4013-ac55-df97655fdf1a on hv-cinder-84762 Jun 24 23:54:26.816175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-dbf29955-33de-4948-832f-8e35cb49412b req-d2f34872-1f0d-4678-8211-53cabb174acb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097454 Jun 24 23:54:26.817093 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 412/837] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:27.055237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:27.055839 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:27.063514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.064162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.065233 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.065819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.217991 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:27.226469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-671d3c29-10ae-4fac-8946-a2e7c4a829d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1683 microversion: 2.1 time: 0.174906 Jun 24 23:54:27.236973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 426/838] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:27 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:27.381335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:27.382568 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: 6babba1a-e4d5-4053-90c2-d201309bd0db] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:27.403116 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.404644 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.406203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.406866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.430613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] HTTP exception thrown: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Request method failure captured: Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db HTTP/1.1 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1cBwVNNAxzE76WSZ8Z5p_LLGlX35aLEOjd_VyWHbkJiifV0IDEEgVkGvKSSQxP0JG63sFpYFnpscPv3x-NCeF5U4Rxs6iWTIElzw7WhF4qXW-Dh_TiZCRupUIRCRz_IIRhQuZqTHn5KIp0cMPM7pBr19m2AP0RUpt7rv7TP66P5FE Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:27.432170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}] Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 5eb7e8b4befd4d519b440c632b59e724 Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. Jun 24 23:54:27.433561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '6babba1a-e4d5-4053-90c2-d201309bd0db'} Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:27.434288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. Jun 24 23:54:27.436280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:27.440193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Returning 404 to user: Instance 6babba1a-e4d5-4053-90c2-d201309bd0db could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:27.441468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-eab54e98-587c-4c72-9e11-7172dc31a472 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db" status: 404 len: 111 microversion: 2.1 time: 0.065225 Jun 24 23:54:27.442459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 413/839] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:27 2022] GET /compute/v2.1/servers/6babba1a-e4d5-4053-90c2-d201309bd0db => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:54:27.451861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:27.451996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:27.463943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.465069 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.465910 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.467071 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.503492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:54:27.614455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-841815d3-bf11-4f04-8cab-4a8d2f5ee0f6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 204 len: 0 microversion: 2.1 time: 0.167729 Jun 24 23:54:27.615346 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 427/840] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:54:27 2022] DELETE /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:54:27.625315 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:27.625935 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:27.629476 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:27.641952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.642436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.644727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.645561 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.685968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:27.687284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:27.693460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.693905 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.694889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:27.695311 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:27.843578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:27.852481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a3acedc2-8c4c-4317-8327-0f76136d1b07 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.171412 Jun 24 23:54:27.853102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 428/841] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:27 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:27.877412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:27.885579 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-280a85d6-a83f-42f6-867c-79556cfba3b6 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.265162 Jun 24 23:54:27.886212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 414/842] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:27 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:28.153734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:28.154432 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:28.160468 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.161022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.161786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.162221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.185794 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-18e882cc-4a17-4f19-a0b8-b05c3cef2afa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/ips" status: 200 len: 152 microversion: 2.20 time: 0.139787 Jun 24 23:54:28.186363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 429/843] 10.222.0.47 () {60 vars in 1288 bytes} [Fri Jun 24 23:54:28 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/ips => generated 152 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:54:28.245960 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:28.246568 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:28.258380 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.259136 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.260174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.261485 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.292108 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-613fd849-dc48-475a-9cf6-fe0739ef3390 req-f6caa9db-428b-439a-a6b6-fe99c7ffc562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6825b3-9d28-448f-a8bd-7580e4da3246", "name": "network-vif-deleted", "tag": "d884fcf0-de2a-48df-a182-394ee1bb281d"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:28.301183 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-613fd849-dc48-475a-9cf6-fe0739ef3390 req-f6caa9db-428b-439a-a6b6-fe99c7ffc562 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.302063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-613fd849-dc48-475a-9cf6-fe0739ef3390 req-f6caa9db-428b-439a-a6b6-fe99c7ffc562 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.320079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-613fd849-dc48-475a-9cf6-fe0739ef3390 req-f6caa9db-428b-439a-a6b6-fe99c7ffc562 service nova] Creating event network-vif-deleted:d884fcf0-de2a-48df-a182-394ee1bb281d for instance dc6825b3-9d28-448f-a8bd-7580e4da3246 on hv-cinder-84762 Jun 24 23:54:28.325754 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-613fd849-dc48-475a-9cf6-fe0739ef3390 req-f6caa9db-428b-439a-a6b6-fe99c7ffc562 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041409 Jun 24 23:54:28.327021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 430/844] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:28.362871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:28.382184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-68d3c4c4-7eb6-449c-83d0-3d47a939cb7a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1615 microversion: 2.1 time: 0.140800 Jun 24 23:54:28.383026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 415/845] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:28 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1615 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:28.872371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:28.873208 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:28.879512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.880041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.880926 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.881428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.904365 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:28.909723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:28.917255 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.917869 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:28.918941 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:28.919596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:29.033360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:29.040973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-613ee9db-01a0-43b9-ad00-9ff0af1deb22 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.173358 Jun 24 23:54:29.041722 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 431/846] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:28 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:29.076826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:29.084487 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2ae785df-ba20-4a4e-834d-b7da2a9ea866 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.185015 Jun 24 23:54:29.085190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 416/847] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:28 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:29.399517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:29.400055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:29.406961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:29.407413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:29.408173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:29.408639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:29.469562 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:29.476917 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-12a3c99e-22a2-4300-aec2-820c41180846 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1615 microversion: 2.1 time: 0.081321 Jun 24 23:54:29.477477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 432/848] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:29 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1615 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:30.057865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:30.058477 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:30.064966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.065410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.066188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.066599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.086143 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:30.086763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:30.094018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.094492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.095265 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.095701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.119338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lazy-loading 'flavor' on Instance uuid 166dbee0-b4e5-4031-a9e1-15e6a51f137c {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:30.186786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:30.212557 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.220761 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a10c686d-39a3-42ea-a9fe-af0b2ed40688 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.166673 Jun 24 23:54:30.221396 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 417/849] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:30 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:30.225884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:30.226608 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:30.232515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.232999 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.233755 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.234182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.386797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-de158b12-b938-437b-b44b-52c6087c804b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/action" status: 202 len: 0 microversion: 2.20 time: 0.304335 Jun 24 23:54:30.390816 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 433/850] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Jun 24 23:54:30 2022] POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 23:54:30.396998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:30.397998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:30.405496 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.406773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.407753 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.408344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.416158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.424343 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a25efe56-f46c-424e-b967-40617f870e81 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1521 microversion: 2.1 time: 0.201833 Jun 24 23:54:30.425184 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 418/851] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:30 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:30.493075 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:30.493707 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:30.500186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.500654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.501422 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.501852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.533515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:30.533959 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:30.534411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'fault' on Instance uuid dc6825b3-9d28-448f-a8bd-7580e4da3246 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:54:30.552040 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.560546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.562284 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.563421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-65b86b2c-c790-4f06-a120-ce2659946eb7 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.171240 Jun 24 23:54:30.563971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 434/852] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:30 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:30.577849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:30.585274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-152c2395-d1a3-43b7-9eec-0217686299e1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 200 len: 1332 microversion: 2.1 time: 0.096048 Jun 24 23:54:30.585823 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 419/853] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:30 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:31.238347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:31.238974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:31.245488 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.245942 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.246707 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.247689 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.389476 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-e30bd2d4-493e-4f5e-9f2b-cb0b61f9089d req-2e62d288-47e6-4fa8-bd12-b31076c06fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde", "name": "network-vif-deleted", "tag": "61853c07-a05f-4c92-8f9a-24bb65456c57"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:31.403659 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e30bd2d4-493e-4f5e-9f2b-cb0b61f9089d req-2e62d288-47e6-4fa8-bd12-b31076c06fc7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.404419 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e30bd2d4-493e-4f5e-9f2b-cb0b61f9089d req-2e62d288-47e6-4fa8-bd12-b31076c06fc7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.418344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-e30bd2d4-493e-4f5e-9f2b-cb0b61f9089d req-2e62d288-47e6-4fa8-bd12-b31076c06fc7 service nova] Creating event network-vif-deleted:61853c07-a05f-4c92-8f9a-24bb65456c57 for instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde on hv-cinder-84762 Jun 24 23:54:31.418888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:31.423724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-e30bd2d4-493e-4f5e-9f2b-cb0b61f9089d req-2e62d288-47e6-4fa8-bd12-b31076c06fc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039779 Jun 24 23:54:31.424417 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 420/854] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:31.428144 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0afab0ed-6b4d-4d3b-8a59-1b0703cc51db tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.193614 Jun 24 23:54:31.428723 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 435/855] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:31 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:31.443514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:31.444344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:31.452873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.453604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.454535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.454976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.530583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb7e8b4befd4d519b440c632b59e724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4f2aaeed54d0fb16474b971f333d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:31.538043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-66a07454-a598-47a3-bbde-6d989bb80c7b tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 200 len: 1306 microversion: 2.1 time: 0.100239 Jun 24 23:54:31.538588 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 421/856] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:31 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:31.582194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:31.582719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:31.588604 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.589074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.589830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.590267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.602157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:31.602769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:31.609481 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.609932 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.610693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:31.611130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:31.615804 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:31.626413 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 HTTP/1.1 Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:31.628274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:54:31.629599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'dc6825b3-9d28-448f-a8bd-7580e4da3246'} Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:31.630335 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:54:31.631500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:31.632545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:31.632545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1d1343e0-e67d-47bf-a4bf-e4fcb4f09852 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 404 len: 111 microversion: 2.1 time: 0.031358 Jun 24 23:54:31.632545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 422/857] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:31 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:54:31.639511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-02ad4e00-ebb2-4310-87ac-9eb33ccab4ec tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '.version_select at 0x7f7a55a83f70>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:31.660508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-02ad4e00-ebb2-4310-87ac-9eb33ccab4ec tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222786873" status: 202 len: 0 microversion: 2.1 time: 0.025659 Jun 24 23:54:31.661111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 423/858] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Jun 24 23:54:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222786873 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:54:31.742429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:31.765105 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:31.767421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:31.768695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e203002d-6925-47c8-aafb-567244d46927 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.190554 Jun 24 23:54:31.769856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 436/859] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:31 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:32.303503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b4b7a678-9a37-4b31-92d6-fc8e5d223fac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: .version_select at 0x7f7a55a03280>, body: {"keypair": {"name": "tempest-keypair-560500966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvAOpqL27g5hGmRl3iVPZz2+ErmW57hccVpRjBTjooM+u2fj3n1QSkr1Fo4kVdz2MXh0gkFAaLA6UQe7sER0ALj5TMJl0U7KKtgo5UuvK9cYPzY27CbAHOQkgGfQBcQBw=="}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:32.319627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-b4b7a678-9a37-4b31-92d6-fc8e5d223fac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:54:32.323435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-b4b7a678-9a37-4b31-92d6-fc8e5d223fac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'key_pairs'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:54:32.346939 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b4b7a678-9a37-4b31-92d6-fc8e5d223fac tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047295 Jun 24 23:54:32.347513 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 424/860] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:54:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:32.445953 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:32.446568 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:32.454193 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.454639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:32.455395 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.455834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:32.555267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:32.555700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] [instance: ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:32.563706 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.564164 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:32.564970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.565411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:32.579119 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] HTTP exception thrown: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Request method failure captured: Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde HTTP/1.1 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1cBwVNNAxzE76WSZ8Z5p_LLGlX35aLEOjd_VyWHbkJiifV0IDEEgVkGvKSSQxP0JG63sFpYFnpscPv3x-NCeF5U4Rxs6iWTIElzw7WhF4qXW-Dh_TiZCRupUIRCRz_IIRhQuZqTHn5KIp0cMPM7pBr19m2AP0RUpt7rv7TP66P5FE Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:54:32.580703 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7ee4f2aaeed54d0fb16474b971f333d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7ee4f2aaeed54d0fb16474b971f333d6"}]}] Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 7ee4f2aaeed54d0fb16474b971f333d6 Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1897223551 Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 5eb7e8b4befd4d519b440c632b59e724 Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1897223551-project Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. Jun 24 23:54:32.582245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde'} Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:54:32.586600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. Jun 24 23:54:32.588296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:54:32.589377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] Returning 404 to user: Instance ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:54:32.589377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e909bc82-c310-4512-86bd-7d24fddcec25 tempest-ServerRescueNegativeTestJSON-1897223551 tempest-ServerRescueNegativeTestJSON-1897223551-project] 10.222.0.47 "GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde" status: 404 len: 111 microversion: 2.1 time: 0.031085 Jun 24 23:54:32.589377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 425/861] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:32 2022] GET /compute/v2.1/servers/ef8fbd8a-5a61-4c83-bd7b-5251bfdcedde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:54:32.640958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:32.649981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-241eacfd-e322-40a5-a187-b689b81b776a tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.207699 Jun 24 23:54:32.650548 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 437/862] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:32 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:32.787434 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:32.788207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:32.794681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.795224 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:32.796079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:32.796666 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:33.292964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:33.302162 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:33.303902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:33.305268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fdcd4f7d-46fd-4ce1-8bee-ad707851d6d6 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.521987 Jun 24 23:54:33.306051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 426/863] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:32 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:33.667092 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:33.668325 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:33.676212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:33.677074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:33.678236 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:33.678988 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:33.734850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-698759165", "imageRef": "92e2254a-ca95-47ce-bade-1c0f19f90918", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b11b39b-22df-4ca5-82fe-6b58b236b565"}], "security_groups": [{"name": "tempest-securitygroup--1925559961"}], "key_name": "tempest-keypair-560500966", "user_data": "}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:33.831951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:33.839496 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-404de8dc-e9c4-41d1-9ef8-350fa847ddd6 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.176157 Jun 24 23:54:33.840049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 438/864] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:33 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:33.880426 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] validate_networks() for [('3b11b39b-22df-4ca5-82fe-6b58b236b565', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:54:34.323705 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:34.324223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:34.330434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.330877 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:34.331635 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.332061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:34.462709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:34.471153 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:34.472685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:34.473838 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-07e36812-c5f3-421b-8b41-78abad501197 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.154158 Jun 24 23:54:34.474386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 439/865] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:34 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:54:34.532199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:54:34.532649 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:54:34.533121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:54:34.533530 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:54:34.533938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:54:34.542660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.543099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:34.543890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.544320 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:34.561019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:54:34.564949 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Getting quotas for user 04e35f840ef045f0b44fab3e57a1a3c8 and project 040134c568aa46c09ca9e5b077cc5d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:54:34.576779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:54:34.579041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92e2254a-ca95-47ce-bade-1c0f19f90918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:54:34.625884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c906c5ae-89f1-4b9a-b6ec-028912f3d85e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.896161 Jun 24 23:54:34.626832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 427/866] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:54:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 23:54:34.636710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7fd5c539-c581-47ad-b664-0dff9c97ff01 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:34.637321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7fd5c539-c581-47ad-b664-0dff9c97ff01 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:34.700101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7fd5c539-c581-47ad-b664-0dff9c97ff01 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:34.708136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7fd5c539-c581-47ad-b664-0dff9c97ff01 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1240 microversion: 2.1 time: 0.075269 Jun 24 23:54:34.708860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 440/867] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:34 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:34.857781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:34.858415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:34.879586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.879970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:34.880807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:34.881282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:35.139814 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:35.151705 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2798c997-7311-4de5-80e4-8ea6783a462f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.298996 Jun 24 23:54:35.152394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 428/868] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:34 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:35.492493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:35.493126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:35.499070 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:35.499509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:35.500266 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:35.500722 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:35.647294 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:35.657373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:35.659698 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:35.661460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f2ef64dd-e9c2-4d8a-ae1d-09b7d4ceb3cd tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.172642 Jun 24 23:54:35.662533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 441/869] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:35 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:35.728051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:35.729587 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:35.741581 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:35.742341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:35.743408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:35.744074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:35.821880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:35.829908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ae8deb37-1d08-47b2-835a-44bcfe2cc2ea tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1300 microversion: 2.1 time: 0.107419 Jun 24 23:54:35.831059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 429/870] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:35 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:36.170494 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:36.171556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:36.180998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.181500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.182565 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.183121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.339777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:36.354856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dc4a800b-dbc9-435a-af03-113077dfed05 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.189957 Jun 24 23:54:36.355450 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 442/871] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:36 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:36.679337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:36.680669 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:36.688369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.689161 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.690196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.690853 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.849381 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:36.850894 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:36.858006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.858578 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.859590 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:36.860144 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:36.936089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:36.945430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a0a161a9-51e5-4f07-9071-d2832ce34e23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1298 microversion: 2.1 time: 0.101965 Jun 24 23:54:36.946417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 443/872] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:36 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:36.968460 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:36.977288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:36.979033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:36.980729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-86d2cb25-23f7-4619-89b0-b806781cc880 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.305231 Jun 24 23:54:36.982113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 430/873] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:36 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:54:37.373332 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:37.374074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:37.380503 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:37.380981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:37.381774 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:37.382203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:37.548871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:37.556426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-01e3f49c-4c07-493e-a975-1fe89d104e87 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.187432 Jun 24 23:54:37.556963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 444/874] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:37 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:37.963182 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:37.963802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:37.970620 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:37.971070 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:37.973615 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:37.974252 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.000077 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:38.000658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:38.008170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:38.008687 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.009428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:38.009966 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.215032 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:38.223889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:38.225434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:38.227149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2ff2e05c-1789-4755-9d04-4fb1079b5180 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.231903 Jun 24 23:54:38.228221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 445/875] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:37 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:54:38.290423 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-f69d9a8a-45e9-45b6-b384-121affd5bca2 req-2d2ca14b-3056-42ba-8836-3e14471cea5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c15c87c-4981-4d73-8670-3fa1f5cf9794", "tag": "4440ef45-f6aa-440b-9d28-0a3d88c8441f"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:38.296996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:38.305990 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f69d9a8a-45e9-45b6-b384-121affd5bca2 req-2d2ca14b-3056-42ba-8836-3e14471cea5d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:38.307150 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-f69d9a8a-45e9-45b6-b384-121affd5bca2 req-2d2ca14b-3056-42ba-8836-3e14471cea5d service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.316382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0813ef7d-6ed3-4ad6-aacf-3ce734f2dbba tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.356924 Jun 24 23:54:38.316995 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 431/876] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:37 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:38.330272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-f69d9a8a-45e9-45b6-b384-121affd5bca2 req-2d2ca14b-3056-42ba-8836-3e14471cea5d service nova] Creating event network-changed:4440ef45-f6aa-440b-9d28-0a3d88c8441f for instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 on hv-cinder-84762 Jun 24 23:54:38.336390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-f69d9a8a-45e9-45b6-b384-121affd5bca2 req-2d2ca14b-3056-42ba-8836-3e14471cea5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049906 Jun 24 23:54:38.337042 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 446/877] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:38.574099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:38.574712 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:38.582142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:38.582539 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.583282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:38.583903 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:38.825646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:38.835545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-da1329f6-74fb-4ec4-9bb1-956af0e75652 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.265300 Jun 24 23:54:38.836234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 432/878] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:38 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:39.250755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:39.252428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:39.271353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.271805 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:39.272822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.273280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:39.334614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:39.335436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:39.344458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.345022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:39.346988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.347492 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:39.431788 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:39.444072 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:39.445996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:39.447420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c64e34dc-370c-4e96-a837-5cf279cb0f86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.204607 Jun 24 23:54:39.460974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 447/879] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:39 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:54:39.520333 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:39.528906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3fd1f43b-2099-4b8d-ba79-78e260a2ed5d tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.199080 Jun 24 23:54:39.529476 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 433/880] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:39 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:39.855731 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:39.857200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:39.863997 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.864899 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:39.866405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:39.867379 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:40.148813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:40.160954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-21179b34-5339-4b4a-856e-ea937c6e5922 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.308970 Jun 24 23:54:40.172519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 448/881] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:39 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:40.468180 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:40.468850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:40.477826 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:40.478731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:40.479827 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:40.480626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:40.547179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:40.547791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:40.555491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:40.556316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:40.557755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:40.558204 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:40.732478 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:40.741964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7eb99da5-21fc-441a-9ed0-8bfd6f5b8bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.199439 Jun 24 23:54:40.742596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 449/882] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:40 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:40.779196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:40.787892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:40.789959 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:40.791339 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3d361cf5-ee25-46f6-bd14-7b4c4a05232e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.328054 Jun 24 23:54:40.792074 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 434/883] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:40 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:41.179333 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:41.179939 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:41.186647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.187087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:41.187843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.188271 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:41.429331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:41.439786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2ee559ea-5335-499a-83fe-5d4b81508b76 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.264384 Jun 24 23:54:41.440347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 450/884] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:41 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:41.759531 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:41.760085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:41.767232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.767667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:41.768417 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.768884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:41.811138 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:41.811798 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:41.818239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.819082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:41.819454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:41.819883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:42.007856 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:42.018236 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:42.020678 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:42.037791 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-375959df-1039-4263-bb59-d317242804d0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.229093 Jun 24 23:54:42.038740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 451/885] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:41 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:42.058266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:42.070277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a5123409-f16e-4329-8ad1-80170c6d60d7 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.313782 Jun 24 23:54:42.071148 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 435/886] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:41 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:42.111919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-1bdbbed2-d7ab-461c-bd89-83ee8184218d req-b8ab05cc-2c7d-4852-a200-69405c52de2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "name": "network-vif-plugged", "status": "completed", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:42.121813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-1bdbbed2-d7ab-461c-bd89-83ee8184218d req-b8ab05cc-2c7d-4852-a200-69405c52de2b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:42.122628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-1bdbbed2-d7ab-461c-bd89-83ee8184218d req-b8ab05cc-2c7d-4852-a200-69405c52de2b service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:42.126632 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=100 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:42.136670 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-1bdbbed2-d7ab-461c-bd89-83ee8184218d req-b8ab05cc-2c7d-4852-a200-69405c52de2b service nova] Creating event network-vif-plugged:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:54:42.145474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-1bdbbed2-d7ab-461c-bd89-83ee8184218d req-b8ab05cc-2c7d-4852-a200-69405c52de2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037242 Jun 24 23:54:42.147142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 452/887] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:54:42.458014 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:42.458886 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:42.465667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:42.466483 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:42.467545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:42.468134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:42.628718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:42.636691 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-94cec605-3f87-4d25-9209-5fe7a7838bfe tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1577 microversion: 2.1 time: 0.182930 Jun 24 23:54:42.637290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 436/888] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:42 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:43.056836 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:43.057576 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:43.065015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.065469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.066246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.066692 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.087268 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:43.087971 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:43.094731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.095179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.095940 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.096372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.211175 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:43.220375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:43.222634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:43.224148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-804aac3b-229c-4b61-a0fa-c26108c7d101 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.171625 Jun 24 23:54:43.225207 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 453/889] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:43 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:43.260984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:43.269652 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-290cfce4-fb9c-4686-81fc-fce343ae239b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.185999 Jun 24 23:54:43.270218 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 437/890] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:43 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:43.654878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:43.655607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:43.661657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.662109 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.662884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:43.663324 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:43.798472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:43.807094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-011720ec-f199-4e81-835b-5dc8dee53485 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1564 microversion: 2.1 time: 0.156347 Jun 24 23:54:43.807723 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 454/891] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:43 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:54:44.177760 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-76c576cf-3777-406a-a39b-63d434b09032 req-4e8e3656-6f8f-4397-98b0-ba1b16fad6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c15c87c-4981-4d73-8670-3fa1f5cf9794", "name": "network-vif-plugged", "status": "completed", "tag": "4440ef45-f6aa-440b-9d28-0a3d88c8441f"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:44.186672 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-76c576cf-3777-406a-a39b-63d434b09032 req-4e8e3656-6f8f-4397-98b0-ba1b16fad6fb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:44.187113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-76c576cf-3777-406a-a39b-63d434b09032 req-4e8e3656-6f8f-4397-98b0-ba1b16fad6fb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:44.197640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-76c576cf-3777-406a-a39b-63d434b09032 req-4e8e3656-6f8f-4397-98b0-ba1b16fad6fb service nova] Creating event network-vif-plugged:4440ef45-f6aa-440b-9d28-0a3d88c8441f for instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 on hv-cinder-84762 Jun 24 23:54:44.203171 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-76c576cf-3777-406a-a39b-63d434b09032 req-4e8e3656-6f8f-4397-98b0-ba1b16fad6fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028974 Jun 24 23:54:44.203746 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 438/892] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:44.246282 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:44.248167 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:44.255981 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:44.256543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:44.257581 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:44.258441 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:44.287131 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:44.287831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:44.306598 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:44.307091 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:44.307888 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:44.308329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:44.433336 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:44.441731 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:44.443240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:44.444459 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b44b9a36-febd-4241-9ed1-1341b0c13fbf tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.202630 Jun 24 23:54:44.444988 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 455/893] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:44 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:44.538786 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:44.546944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-138109b3-3080-4c10-9137-42dea6914bf6 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.264155 Jun 24 23:54:44.547515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 439/894] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:44 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:45.463931 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:45.464532 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:45.467103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:45.473119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:45.473560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:45.474312 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:45.474740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:45.563662 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:45.564327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:45.566281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:45.567071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=10 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:45.573613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:45.574060 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:45.575505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:45.575942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:45.604667 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:45.612864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:45.614385 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:45.615557 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6e31426b-ee46-4393-ac54-e6a4562562d4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.155666 Jun 24 23:54:45.616273 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 456/895] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:45 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:45.705871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:45.713505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a461b5f8-e312-441e-8923-d8e8d7198887 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1366 microversion: 2.1 time: 0.153712 Jun 24 23:54:45.714159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 440/896] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:45 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:46.634203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:46.634831 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:46.642045 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.642487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.643238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.643698 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.730211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:46.731090 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:46.738248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.738744 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.739837 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.740323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.776252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:46.785428 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:46.786927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:46.788082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6a37f48e-f4fd-417b-9c7a-20e66e7ca072 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1745 microversion: 2.20 time: 0.157770 Jun 24 23:54:46.788644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 457/897] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:46 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:46.873885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:46.881322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ff443494-2cf2-4696-a739-d5f6a13977c1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1556 microversion: 2.1 time: 0.154936 Jun 24 23:54:46.881883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 441/898] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:54:46 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:54:46.897998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:46.898460 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:46.901329 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:46.905502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.905953 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.906716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:46.907159 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:46.986964 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e8889175-4d60-4c60-bbfc-a403f5e0239a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093011 Jun 24 23:54:46.987551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 458/899] 10.222.0.47 () {58 vars in 1274 bytes} [Fri Jun 24 23:54:46 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:47.807175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:47.807812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:47.814535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:47.814988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:47.815784 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:47.816220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:47.953694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:47.966411 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:47.968204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:47.969420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d25532d2-1c84-4534-9561-390668893c75 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1745 microversion: 2.20 time: 0.166135 Jun 24 23:54:47.969973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 442/900] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:47 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:48.155541 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-bbe8389a-141c-4090-ab7b-73e5ec252a0b req-e2c5d9d4-aa6f-4cbf-bc48-54d76a00fce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c15c87c-4981-4d73-8670-3fa1f5cf9794", "tag": "4440ef45-f6aa-440b-9d28-0a3d88c8441f"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:48.163619 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bbe8389a-141c-4090-ab7b-73e5ec252a0b req-e2c5d9d4-aa6f-4cbf-bc48-54d76a00fce5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:48.164041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bbe8389a-141c-4090-ab7b-73e5ec252a0b req-e2c5d9d4-aa6f-4cbf-bc48-54d76a00fce5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:48.176709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-bbe8389a-141c-4090-ab7b-73e5ec252a0b req-e2c5d9d4-aa6f-4cbf-bc48-54d76a00fce5 service nova] Creating event network-changed:4440ef45-f6aa-440b-9d28-0a3d88c8441f for instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 on hv-cinder-84762 Jun 24 23:54:48.182015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-bbe8389a-141c-4090-ab7b-73e5ec252a0b req-e2c5d9d4-aa6f-4cbf-bc48-54d76a00fce5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031686 Jun 24 23:54:48.183319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 459/901] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:48.988451 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:48.989284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:48.996089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:48.996867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:48.997858 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:48.998277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:49.020170 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=100 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:49.307444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:49.316303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:49.317884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:49.319191 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-829971db-7157-4a16-8251-210060bb71a3 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1745 microversion: 2.20 time: 0.335245 Jun 24 23:54:49.319752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 443/902] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:48 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:50.337524 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:50.338223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:50.345921 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:50.346368 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:50.347129 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:50.347564 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:50.480753 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:50.488763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:50.490308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:50.491404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-dc937500-23ff-449d-9b14-235f51999149 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1745 microversion: 2.20 time: 0.158231 Jun 24 23:54:50.491954 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 460/903] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:50 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:51.510338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:51.510954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:51.519129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:51.519782 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:51.520560 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:51.521026 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:51.688159 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:51.696718 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:51.700172 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:51.701854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6f9226c0-06ef-4f5e-a019-467c962c8120 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.196406 Jun 24 23:54:51.702976 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 444/904] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:51 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:52.721804 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:52.723448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:52.737237 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:52.738008 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:52.739337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:52.740003 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:52.846985 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-a951bf34-bbf8-465b-8c11-835d2d923bbc req-f2e44742-dd50-4dc7-a8b4-c6fcba2218e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "name": "network-vif-plugged", "status": "completed", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:54:52.859022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-a951bf34-bbf8-465b-8c11-835d2d923bbc req-f2e44742-dd50-4dc7-a8b4-c6fcba2218e7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:52.865297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-a951bf34-bbf8-465b-8c11-835d2d923bbc req-f2e44742-dd50-4dc7-a8b4-c6fcba2218e7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:52.884889 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-a951bf34-bbf8-465b-8c11-835d2d923bbc req-f2e44742-dd50-4dc7-a8b4-c6fcba2218e7 service nova] Creating event network-vif-plugged:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:54:52.890677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-a951bf34-bbf8-465b-8c11-835d2d923bbc req-f2e44742-dd50-4dc7-a8b4-c6fcba2218e7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047548 Jun 24 23:54:52.891515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 445/905] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:54:52.935813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:52.957194 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:52.963008 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:52.967727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bcdf2c46-219b-4895-84d8-cc22af94d0cb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.250686 Jun 24 23:54:52.980603 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 461/906] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:52 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:53.987575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:53.988769 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:53.997641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:53.998257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:53.999128 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:53.999637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:54.158595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:54.167441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:54.169738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:54.171096 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-335f9cc5-7ad3-4bdc-afad-3025a9bef67d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.187974 Jun 24 23:54:54.171783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 446/907] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:53 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:55.189951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:55.193126 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:55.201363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:55.201902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:55.202756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:55.203255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:55.362371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:55.372172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:55.373884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:55.375312 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-be3b3850-1dbb-4610-88f2-44d117f8c8ec tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.189313 Jun 24 23:54:55.376742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 462/908] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:55 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:56.396317 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:56.397107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:56.405246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:56.405809 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:56.406996 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:56.409605 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:56.564673 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:56.579586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:56.581168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:56.582347 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-75f7265f-ef69-4cd2-b7b0-f532d3c4230a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.190273 Jun 24 23:54:56.596077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 447/909] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:56 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:57.603980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:57.605686 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:57.612652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:57.614179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:57.614912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:57.615543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:57.784637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:57.793655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:57.795559 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:57.796796 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3ab0c5d9-e39e-4cab-a213-6332edef1def tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.197482 Jun 24 23:54:57.797436 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 463/910] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:57 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:54:58.815289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:54:58.816803 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:54:58.820752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:54:58.829575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:58.830264 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:58.831210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:54:58.831812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:54:59.005296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:59.014202 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:59.015719 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:54:59.017050 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4c6f7e56-8d7f-4d4c-87a5-142e390fe947 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.205536 Jun 24 23:54:59.030382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 448/911] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:54:58 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:55:00.037508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:00.038121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:00.050106 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:00.050762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:00.051869 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:00.052321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:00.199691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:00.207921 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:00.209464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:00.210639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-690cb375-1aec-47bb-9adf-60246aded39a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1740 microversion: 2.20 time: 0.177244 Jun 24 23:55:00.211487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 464/912] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:00 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:01.229465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:01.230552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:01.237462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:01.237910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:01.238680 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:01.239109 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:01.570593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:01.579213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:01.580729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:01.581884 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0a0fa345-0231-417e-a743-84c2bf604c93 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1722 microversion: 2.20 time: 0.356548 Jun 24 23:55:01.582655 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 449/913] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:01 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:02.601323 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:02.602023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:02.608507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:02.608980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:02.609735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:02.610170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:02.740635 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:02.750369 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:02.751872 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:02.753102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ded1a0b4-0773-4047-a6be-ab366620ea34 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1722 microversion: 2.20 time: 0.155773 Jun 24 23:55:02.753640 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 465/914] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:02 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:55:02.777273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-7fb799cc-5b75-4fda-8e8a-284210ce8fa8 req-ffdd0287-e609-4035-bdc3-6cf80a1eae37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "name": "network-vif-unplugged", "status": "completed", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:02.788280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7fb799cc-5b75-4fda-8e8a-284210ce8fa8 req-ffdd0287-e609-4035-bdc3-6cf80a1eae37 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:02.789021 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7fb799cc-5b75-4fda-8e8a-284210ce8fa8 req-ffdd0287-e609-4035-bdc3-6cf80a1eae37 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:02.803389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-7fb799cc-5b75-4fda-8e8a-284210ce8fa8 req-ffdd0287-e609-4035-bdc3-6cf80a1eae37 service nova] Creating event network-vif-unplugged:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:55:02.810852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-7fb799cc-5b75-4fda-8e8a-284210ce8fa8 req-ffdd0287-e609-4035-bdc3-6cf80a1eae37 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037977 Jun 24 23:55:02.811550 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 450/915] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:03.772023 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:03.772642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:03.779026 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:03.779498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:03.780313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:03.780773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:03.934859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:03.943224 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:03.944845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:03.946009 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-06e5ee03-38fd-428a-ba38-5bcee09854ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1725 microversion: 2.20 time: 0.178178 Jun 24 23:55:03.946551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 466/916] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:03 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:03.964881 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4417aec1-d64d-49bb-b0d1-0e589c749d0d"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:03.966841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:03.974877 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:03.975450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:03.976368 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:03.976874 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.269099 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a24dccea-34ad-491b-9cfc-d6110b872611 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308257 Jun 24 23:55:04.269710 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 451/917] 10.222.0.47 () {62 vars in 1363 bytes} [Fri Jun 24 23:55:03 2022] POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 23:55:04.384680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:04.385186 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:04.391379 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.391827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.392610 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.393037 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.617324 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-aec813ca-4b4c-4def-852b-9beed218dec0 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments/4417aec1-d64d-49bb-b0d1-0e589c749d0d" status: 202 len: 0 microversion: 2.20 time: 0.236576 Jun 24 23:55:04.618004 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 467/918] 10.222.0.47 () {60 vars in 1456 bytes} [Fri Jun 24 23:55:04 2022] DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments/4417aec1-d64d-49bb-b0d1-0e589c749d0d => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:55:04.675419 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:04.676017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:04.682622 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.683072 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.683846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.684528 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.760642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-665e7356-8b41-4105-bfbe-44c9e788d541 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/action" status: 202 len: 0 microversion: 2.20 time: 0.089077 Jun 24 23:55:04.761294 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 452/919] 10.222.0.47 () {62 vars in 1318 bytes} [Fri Jun 24 23:55:04 2022] POST /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 23:55:04.770415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:04.771050 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:04.777507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.778219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.778725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:04.779154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:04.785080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:04.916802 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:04.925359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:04.926871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:04.928022 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d1ebe28f-b1a8-48dd-8d0f-8f8a33be12da tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1673 microversion: 2.20 time: 0.161778 Jun 24 23:55:04.928575 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 468/920] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:04 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:05.946003 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:05.946669 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:05.953328 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:05.953785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:05.954580 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:05.955020 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:06.174590 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:06.182825 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:06.185089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:06.186308 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e0f8b43c-a946-465a-bbc8-af7a3ba2dd0e tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.244749 Jun 24 23:55:06.186803 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 453/921] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:05 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:07.204847 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:07.205458 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:07.211851 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:07.212303 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:07.213097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:07.213536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:07.343392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:07.351248 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:07.352802 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:07.353962 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cddc7be4-9a5b-47f5-8506-3e145a2d4844 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.153066 Jun 24 23:55:07.354521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 469/922] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:07 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:08.372340 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:08.372983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:08.379806 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:08.380270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:08.381101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:08.381546 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:08.552680 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:08.563036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:08.566084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:08.566247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-296feb7d-46ca-4e99-bd9c-9dd47aec2804 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.198280 Jun 24 23:55:08.577289 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 454/923] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:08 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:09.587292 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:09.587920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:09.595087 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:09.595623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:09.596404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:09.596888 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:09.747759 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:09.755825 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:09.757367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:09.758539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-86b90366-e1e1-4b7b-8a49-20db57868ff5 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.175153 Jun 24 23:55:09.759098 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 470/924] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:09 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:10.646828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:10.647297 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:10.654821 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:10.655267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:10.656031 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:10.656464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:10.679695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2c292c82-c2b9-4a45-b977-6619a8fa92fe tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/ips" status: 200 len: 146 microversion: 2.1 time: 0.036905 Jun 24 23:55:10.680399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 455/925] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:55:10 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:10.777517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:10.778319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:10.784992 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:10.785444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:10.786293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:10.786763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:10.947885 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:10.965034 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:10.968424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:10.970202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2ff68e96-6702-4596-8948-a87122088786 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.196636 Jun 24 23:55:10.977984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 471/926] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:10 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:11.998597 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:11.999279 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:12.006687 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:12.007387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:12.008285 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:12.008916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:12.160370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:12.168787 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:12.170983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:12.172204 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6bcb05ac-ba89-4e2b-9f6f-807fc5fee766 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.181109 Jun 24 23:55:12.172966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 456/927] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:11 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:13.191260 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:13.192823 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:13.200371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:13.200858 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:13.202410 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:13.202839 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:13.351916 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:13.360771 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:13.362397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:13.363718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f8f79456-65eb-49fb-a21c-4bab5976df4a tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.176742 Jun 24 23:55:13.364417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 472/928] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:13 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:14.205772 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b05b168-6d6a-4381-bc74-fa98867fb2a7"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:14.208017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:14.214749 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:14.215203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:14.216019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:14.216644 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:14.383436 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:14.384112 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:14.391051 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:14.391508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:14.392272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:14.392961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:14.540710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:14.548967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:14.550462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:14.551617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-40c92c0b-1d10-44a7-92ce-dd5c76bb2eac tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.172261 Jun 24 23:55:14.552378 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 473/929] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:14 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:55:15.570449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:15.571283 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:15.577971 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:15.578411 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:15.579176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:15.579790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:15.744739 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:15.754061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:15.755662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:15.757019 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b1d34c44-1f4b-4a8f-9a27-48382b0ec4f4 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.190661 Jun 24 23:55:15.757854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 474/930] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:15 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:55:16.775735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:16.776493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:16.787647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:16.788104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:16.788919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:16.789356 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:16.942228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:16.951946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:16.953519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:16.954683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5e7e5191-c6d5-4dd8-b823-4903c334f0d2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.182939 Jun 24 23:55:16.955241 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 475/931] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:16 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:17.305221 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:17.420340 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ffec7131-3bcc-4f65-aa9d-023d16df12c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.218452 Jun 24 23:55:17.421102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 457/932] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:55:14 2022] POST /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 194 bytes in 3221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:55:17.971976 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:17.972715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:17.975063 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=35 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:17.980767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:17.981217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:17.981973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:17.982405 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:18.302591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:18.311183 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:18.312711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:18.313861 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-eb8e0b11-d1de-480b-9581-b5ac480489a9 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.345708 Jun 24 23:55:18.314397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 476/933] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:17 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:19.332463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:19.333206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:19.339839 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:19.341010 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:19.341985 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:19.342430 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:19.484166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:19.493049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:19.494831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:19.496030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6c57e59c-55ef-4fba-9aa3-bbaa59912f15 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.167977 Jun 24 23:55:19.496766 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 458/934] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:19 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:20.514553 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:20.515186 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:20.521847 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:20.522298 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:20.523050 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:20.523480 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:20.659107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:20.667090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:20.668649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:20.669813 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-82df5652-8e36-4bd4-8f0f-da04d9d7cf63 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.159647 Jun 24 23:55:20.670361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 477/935] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:20 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:21.687448 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:21.688051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:21.694463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:21.694906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:21.695662 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:21.696100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:21.826435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:21.834257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:21.835771 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:21.836958 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f180baf7-50a3-4745-b458-6ed2f0b55af8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.153718 Jun 24 23:55:21.837512 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 459/936] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:21 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:22.615783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-5c2d8c6e-30b8-4180-89a3-662b6e10b536 req-19e5f453-545a-40b7-bfda-30f60ecf5d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "name": "network-vif-plugged", "status": "completed", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:22.626714 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-5c2d8c6e-30b8-4180-89a3-662b6e10b536 req-19e5f453-545a-40b7-bfda-30f60ecf5d1a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:22.627588 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-5c2d8c6e-30b8-4180-89a3-662b6e10b536 req-19e5f453-545a-40b7-bfda-30f60ecf5d1a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:22.642821 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-5c2d8c6e-30b8-4180-89a3-662b6e10b536 req-19e5f453-545a-40b7-bfda-30f60ecf5d1a service nova] Creating event network-vif-plugged:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:55:22.648119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-5c2d8c6e-30b8-4180-89a3-662b6e10b536 req-19e5f453-545a-40b7-bfda-30f60ecf5d1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 Jun 24 23:55:22.648900 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 478/937] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:55:22.857630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:22.859646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:22.867429 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:22.868270 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:22.869452 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:22.870848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:23.045922 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:23.054599 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:23.056305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:23.057704 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9b4d8965-09f3-4ef1-a546-1214de5c32ad tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.206026 Jun 24 23:55:23.058353 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 460/938] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:22 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:24.077685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:24.078377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:24.084500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:24.084980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:24.085747 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:24.086184 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:24.215355 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:24.224347 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:24.226412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:24.227715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2e77e397-99f6-4303-9f35-28c0fc50ac51 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1731 microversion: 2.20 time: 0.155594 Jun 24 23:55:24.228272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 479/939] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:24 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:25.248063 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:25.248610 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:25.257360 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:25.258183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:25.258742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:25.259174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:25.406910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:25.418967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:25.420500 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:25.421711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-95cd8e1f-d0fe-4665-b398-7a68f53c6ccb tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1718 microversion: 2.20 time: 0.178403 Jun 24 23:55:25.422265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 461/940] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:25 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:55:26.322252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:26.325104 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:26.331595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:26.332050 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:26.332858 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:26.333300 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:26.364757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d1e06b3e-3793-4a5c-9a45-d953a5455c24 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046274 Jun 24 23:55:26.365213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 480/941] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:26 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:26.376212 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:26.376774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:26.383260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:26.383615 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:26.384383 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:26.384852 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:26.417185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6c989c0d-dab7-4b64-b9ed-d464abae758a tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7" status: 200 len: 194 microversion: 2.1 time: 0.045778 Jun 24 23:55:26.418100 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 462/942] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Jun 24 23:55:26 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:55:27.764419 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1d32537-b6ad-4e86-89f4-bc3115a7710d"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:27.765647 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:27.771999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:27.772510 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:27.773353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:27.773859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:28.023242 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5f98aabf-c286-4564-afd9-064277522e32 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "POST /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263054 Jun 24 23:55:28.023966 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 481/943] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:55:27 2022] POST /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:32.866849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:32.867408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:32.871196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=32 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:32.875841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:32.876386 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:32.877195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:32.877639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:32.910011 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8a323b45-503d-466d-98ad-24695f80fe48 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/ips" status: 200 len: 149 microversion: 2.1 time: 0.046986 Jun 24 23:55:32.910574 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 463/944] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:55:32 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:34.266319 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35ce77a4-4a3a-4a44-9b3d-4b5e6391bd20"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:34.267492 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:34.274041 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:34.274486 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:34.275255 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:34.275691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:34.744114 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:34.756903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6274d419-e6d7-4523-8fb8-2e90719d7e00 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "POST /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495996 Jun 24 23:55:34.757501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 482/945] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:55:34 2022] POST /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:35.515531 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:35.516531 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:35.523211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.523658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.524416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.524885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.553973 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a99cc233-782d-4fe1-8c62-0525efbe94c3 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042590 Jun 24 23:55:35.554508 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 464/946] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:35 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:35.695613 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:35.696154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:35.702914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.703364 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.704132 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.704572 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.732989 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a7f240ea-4952-4429-b97a-77003f7157a6 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7" status: 200 len: 194 microversion: 2.1 time: 0.042256 Jun 24 23:55:35.733551 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 483/947] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Jun 24 23:55:35 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:35.743983 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:35.744471 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:35.750416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.750862 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.751617 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:35.752049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:35.833653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lazy-loading 'services' on Instance uuid 344f8883-ac33-4013-ac55-df97655fdf1a {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:55:35.907903 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-12be164f-2579-4cf7-af22-901d413e1003 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7" status: 202 len: 0 microversion: 2.1 time: 0.168523 Jun 24 23:55:35.908724 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 465/948] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:55:35 2022] DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/4b05b168-6d6a-4381-bc74-fa98867fb2a7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:55:42.312100 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:42.312632 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:42.318959 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.319413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.320173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.320637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.350493 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4569f7e0-3516-4c24-9c5b-c4cc32bc4dbb tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/b1d32537-b6ad-4e86-89f4-bc3115a7710d" status: 200 len: 194 microversion: 2.1 time: 0.043669 Jun 24 23:55:42.351060 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 484/949] 10.222.0.47 () {58 vars in 1412 bytes} [Fri Jun 24 23:55:42 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/b1d32537-b6ad-4e86-89f4-bc3115a7710d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:42.354747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:42.355527 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:42.360313 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:42.360843 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:42.362257 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.362709 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.363471 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.363902 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.366676 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.367125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.367878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.368314 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.449386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lazy-loading 'services' on Instance uuid 344f8883-ac33-4013-ac55-df97655fdf1a {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:55:42.450006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'services' on Instance uuid 5c15c87c-4981-4d73-8670-3fa1f5cf9794 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:55:42.525430 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-04396614-75d9-4b6c-9a7c-b40589df9f52 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/b1d32537-b6ad-4e86-89f4-bc3115a7710d" status: 202 len: 0 microversion: 2.1 time: 0.168582 Jun 24 23:55:42.525887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6554c729-1c5b-423e-86dd-0da6534b55b9 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments/35ce77a4-4a3a-4a44-9b3d-4b5e6391bd20" status: 202 len: 0 microversion: 2.1 time: 0.175308 Jun 24 23:55:42.527217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 466/950] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:55:42 2022] DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments/35ce77a4-4a3a-4a44-9b3d-4b5e6391bd20 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:55:42.527874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 485/951] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:55:42 2022] DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments/b1d32537-b6ad-4e86-89f4-bc3115a7710d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:55:42.536113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:42.537209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:42.545028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.545710 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.546807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:42.547399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:42.582748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-381fe18c-a08b-4045-b8c7-05327e9b211f tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051101 Jun 24 23:55:42.583370 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 467/952] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:42 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:55:43.594296 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:43.595490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:43.606844 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.607301 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:43.608088 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.611541 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:43.655644 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-53aa71cd-95de-4845-b7bb-9ea03f65326e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065635 Jun 24 23:55:43.656618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 486/953] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:43 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:55:43.716160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:43.717750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:43.725298 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.725750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:43.726521 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.726951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:43.756219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:55:43.836785 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9db8aa73-f91a-4960-95b4-6735e3a146f3 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 204 len: 0 microversion: 2.1 time: 0.125314 Jun 24 23:55:43.837972 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 468/954] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:43 2022] DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:55:43.847715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:43.848326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:43.854449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.855783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:43.856744 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:43.857191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:44.001219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:44.008654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5f5a5956-aa5e-4b4e-be69-402ab536549b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1680 microversion: 2.1 time: 0.164985 Jun 24 23:55:44.009145 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 487/955] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:43 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:55:44.778454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:44.779474 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:44.785912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:44.786365 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:44.787132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:44.787577 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:44.819302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-95310e55-34bd-4f18-8d5d-1db25ca832ff tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Jun 24 23:55:44.820127 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 469/956] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:44 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:45.027189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:45.027889 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:45.034515 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:45.034963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:45.035770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:45.036549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:45.172817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:45.180392 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-129eeaa4-910f-46dd-bee6-40d9f6da264e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1680 microversion: 2.1 time: 0.157332 Jun 24 23:55:45.180767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 488/957] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:45 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:55:45.831400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:45.832323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:45.838758 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:45.839356 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:45.840130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:45.840564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:45.865944 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:45.871062 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-33948b3c-c77e-4e09-9809-1e01fd578fd8 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042796 Jun 24 23:55:45.871963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 470/958] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:45 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:55:46.004511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:46.005755 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:46.014916 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.015363 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.016139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.016573 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.049549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-420c0a3c-2205-4846-945e-68fe7189c452 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050123 Jun 24 23:55:46.051139 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 489/959] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:55:45 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:55:46.118337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:46.118753 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:46.125908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.126360 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.127316 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.127989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.154864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:55:46.197579 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:46.198511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:46.204547 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.205028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.206156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.206614 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.252019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f5e3bb47-6d91-4848-ab08-9ce15d5ebfc7 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 204 len: 0 microversion: 2.1 time: 0.137644 Jun 24 23:55:46.252613 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 471/960] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:46 2022] DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:55:46.261855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:46.262891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:46.270226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.283243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.284209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.284694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.300519 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:46.309548 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-df1fd9dc-8f8f-4435-9b9f-08a396f7a0d8 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1612 microversion: 2.1 time: 0.116107 Jun 24 23:55:46.319051 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 490/961] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:46 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:55:46.532662 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:46.540378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-227ac5c5-f416-4fc5-b120-b8d695a2aaef tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1675 microversion: 2.1 time: 0.283437 Jun 24 23:55:46.540966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 472/962] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:46 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1675 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:55:46.717301 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-393868aa-a5db-4cd8-a3b4-a8059e080a90 req-5052ea75-47f9-4729-a44e-ceb3e5b1cf18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c15c87c-4981-4d73-8670-3fa1f5cf9794", "name": "network-vif-deleted", "tag": "4440ef45-f6aa-440b-9d28-0a3d88c8441f"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:46.725790 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-393868aa-a5db-4cd8-a3b4-a8059e080a90 req-5052ea75-47f9-4729-a44e-ceb3e5b1cf18 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:46.726523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-393868aa-a5db-4cd8-a3b4-a8059e080a90 req-5052ea75-47f9-4729-a44e-ceb3e5b1cf18 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:46.739254 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-393868aa-a5db-4cd8-a3b4-a8059e080a90 req-5052ea75-47f9-4729-a44e-ceb3e5b1cf18 service nova] Creating event network-vif-deleted:4440ef45-f6aa-440b-9d28-0a3d88c8441f for instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 on hv-cinder-84762 Jun 24 23:55:46.746400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-393868aa-a5db-4cd8-a3b4-a8059e080a90 req-5052ea75-47f9-4729-a44e-ceb3e5b1cf18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Jun 24 23:55:46.748835 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 491/963] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:55:47.329037 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:47.329829 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:47.337303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:47.338126 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:47.339203 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:47.339733 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:47.411805 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:47.421049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b221ba14-5b1b-453b-9f4e-7f95a2daba23 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1612 microversion: 2.1 time: 0.098587 Jun 24 23:55:47.421700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 473/964] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:47 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:55:47.559073 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:47.559781 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:47.566107 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:47.566539 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:47.567514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:47.567950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:47.714398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:47.723502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d503a157-3e8d-4c54-b2c8-52908b5e12cf tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1675 microversion: 2.1 time: 0.169682 Jun 24 23:55:47.724338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 492/965] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:47 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:55:48.439786 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:48.441354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:48.448372 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:48.449249 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:48.450028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:48.450631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:48.498854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:48.499568 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:48.500191 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.objects.instance [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lazy-loading 'fault' on Instance uuid 5c15c87c-4981-4d73-8670-3fa1f5cf9794 {{(pid=124093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:55:48.561264 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e35f840ef045f0b44fab3e57a1a3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040134c568aa46c09ca9e5b077cc5d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:48.569051 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cedb6c84-f2df-4ca9-80a2-97ff02919090 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 200 len: 1330 microversion: 2.1 time: 0.133864 Jun 24 23:55:48.569815 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 474/966] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:48 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:55:48.741495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:48.742115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:48.744903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=34 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:55:48.751907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:48.752359 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:48.753173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:48.753616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:48.894616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ffbcd7078473f97f42bdb54acf57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a779b000010c4549989d8a8f25e8b1be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:48.904808 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-108ac89d-9cca-415a-9b32-683ecd7918c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 200 len: 1675 microversion: 2.1 time: 0.167237 Jun 24 23:55:48.905288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 493/967] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:48 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 23:55:49.265192 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-37205e11-3761-450e-9002-fc3f63bb80d7 req-fdf77904-dde1-44bd-b26b-422cb4d9f781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344f8883-ac33-4013-ac55-df97655fdf1a", "name": "network-vif-deleted", "tag": "9456be43-2212-4cd8-972c-5adfd0a88919"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:55:49.274193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-37205e11-3761-450e-9002-fc3f63bb80d7 req-fdf77904-dde1-44bd-b26b-422cb4d9f781 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:49.274893 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-37205e11-3761-450e-9002-fc3f63bb80d7 req-fdf77904-dde1-44bd-b26b-422cb4d9f781 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:49.287090 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-37205e11-3761-450e-9002-fc3f63bb80d7 req-fdf77904-dde1-44bd-b26b-422cb4d9f781 service nova] Creating event network-vif-deleted:9456be43-2212-4cd8-972c-5adfd0a88919 for instance 344f8883-ac33-4013-ac55-df97655fdf1a on hv-cinder-84762 Jun 24 23:55:49.293060 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-37205e11-3761-450e-9002-fc3f63bb80d7 req-fdf77904-dde1-44bd-b26b-422cb4d9f781 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Jun 24 23:55:49.293616 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 475/968] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:55:49.588449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:49.589762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:49.595827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:49.596285 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:49.597161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:49.597605 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:49.610735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 HTTP/1.1 Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:49.612477 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:49.614127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '5c15c87c-4981-4d73-8670-3fa1f5cf9794'} Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:49.614963 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:49.616513 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.617865 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:49.617865 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-8f3a0c9a-0113-490b-a007-7206460b7a72 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 404 len: 111 microversion: 2.1 time: 0.029524 Jun 24 23:55:49.617865 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 494/969] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:49 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:49.628176 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4ee7bd76-c5f2-41db-9156-7544d2e0620b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '.version_select at 0x7f7a55a83d30>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:49.647045 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4ee7bd76-c5f2-41db-9156-7544d2e0620b tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-560500966" status: 202 len: 0 microversion: 2.1 time: 0.023496 Jun 24 23:55:49.647879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 476/970] 10.222.0.47 () {58 vars in 1217 bytes} [Fri Jun 24 23:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-560500966 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:55:49.923807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:49.925036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:49.936768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:49.939116 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:49.941248 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:49.941974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:49.969556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a HTTP/1.1 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:49.973269 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:49.974881 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '344f8883-ac33-4013-ac55-df97655fdf1a'} Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:49.975768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:49.977340 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:49.979690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:49.979690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6633119d-3a55-4ab9-b247-0c2dd4eea4da tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 404 len: 111 microversion: 2.1 time: 0.056118 Jun 24 23:55:49.979690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 495/971] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:49 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:49.988572 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1a2630e2-d224-47f7-884c-549077081e15 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '.version_select at 0x7f7a55b249d0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:50.019071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1a2630e2-d224-47f7-884c-549077081e15 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018124302" status: 202 len: 0 microversion: 2.1 time: 0.036215 Jun 24 23:55:50.022406 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 477/972] 10.222.0.47 () {58 vars in 1220 bytes} [Fri Jun 24 23:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018124302 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:55:51.601348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:51.601854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:51.608331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:51.608819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:51.609594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:51.610039 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:51.625122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 HTTP/1.1 Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:51.626674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.628197 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '5c15c87c-4981-4d73-8670-3fa1f5cf9794'} Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:51.629240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.630709 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.632172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:51.632172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c95ccd91-847b-4e22-af52-3b15c6e42e36 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 404 len: 111 microversion: 2.1 time: 0.031467 Jun 24 23:55:51.632172 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 496/973] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:51 2022] DELETE /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:51.637248 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:51.637979 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 5c15c87c-4981-4d73-8670-3fa1f5cf9794] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:51.644350 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:51.644833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:51.645596 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:51.646032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:51.662478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 HTTP/1.1 Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:51.665559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.667817 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '5c15c87c-4981-4d73-8670-3fa1f5cf9794'} Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:51.669067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. Jun 24 23:55:51.670632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:51.672081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 5c15c87c-4981-4d73-8670-3fa1f5cf9794 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:51.672081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-96263ad9-8415-4f7e-8b94-b30df1939b38 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794" status: 404 len: 111 microversion: 2.1 time: 0.034522 Jun 24 23:55:51.672081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 478/974] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:51 2022] GET /compute/v2.1/servers/5c15c87c-4981-4d73-8670-3fa1f5cf9794 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:52.811878 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:52.812400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:52.818822 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.819268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.820027 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.820470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.833870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 HTTP/1.1 Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:52.835377 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.836773 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'dc6825b3-9d28-448f-a8bd-7580e4da3246'} Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:52.837601 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.838832 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.840775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:52.840775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-75bcd10a-88b5-4424-837a-adbd5c65f604 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 404 len: 111 microversion: 2.1 time: 0.029541 Jun 24 23:55:52.840775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 497/975] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:52 2022] DELETE /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:52.845295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:52.846076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: dc6825b3-9d28-448f-a8bd-7580e4da3246] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:52.852539 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.853019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.853794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.854229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.868815 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 HTTP/1.1 Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:52.871106 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.872984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'dc6825b3-9d28-448f-a8bd-7580e4da3246'} Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:52.873773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. Jun 24 23:55:52.874967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.876071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance dc6825b3-9d28-448f-a8bd-7580e4da3246 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:52.876071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a606075f-c645-4edb-8666-513690ba5d6a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246" status: 404 len: 111 microversion: 2.1 time: 0.031257 Jun 24 23:55:52.876071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 479/976] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:52 2022] GET /compute/v2.1/servers/dc6825b3-9d28-448f-a8bd-7580e4da3246 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:55:52.881596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:52.882075 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:52.888115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.888563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.889361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.889800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.903799 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e HTTP/1.1 Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:52.905413 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.906996 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'b9248f71-33cb-4319-ba9c-e5e37aabf62e'} Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:52.907866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.909550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.911052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:52.911052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0ad4387d-d6ce-4426-8bc9-81232c7d5dc1 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 404 len: 111 microversion: 2.1 time: 0.029111 Jun 24 23:55:52.911052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 498/977] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:52 2022] DELETE /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:52.915745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:52.916354 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: b9248f71-33cb-4319-ba9c-e5e37aabf62e] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:52.923003 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.923448 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.924205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:52.924731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:52.939892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e HTTP/1.1 Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:52.941696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.943081 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'b9248f71-33cb-4319-ba9c-e5e37aabf62e'} Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:52.943819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. Jun 24 23:55:52.945240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:52.946359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance b9248f71-33cb-4319-ba9c-e5e37aabf62e could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:52.946359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-515ee470-cd62-45ac-90ab-3ae5ced61ef0 tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e" status: 404 len: 111 microversion: 2.1 time: 0.031393 Jun 24 23:55:52.946359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 480/978] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:52 2022] GET /compute/v2.1/servers/b9248f71-33cb-4319-ba9c-e5e37aabf62e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:53.068927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:53.069594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:53.075742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:53.076278 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:53.077133 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:53.077641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:53.091631 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a HTTP/1.1 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:53.093239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.094719 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '344f8883-ac33-4013-ac55-df97655fdf1a'} Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:53.095437 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.096652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.098080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:53.098080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1bb0f507-d366-4618-9a61-e13e8202e46d tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 404 len: 111 microversion: 2.1 time: 0.030281 Jun 24 23:55:53.098080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 499/979] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:53 2022] DELETE /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:53.104420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:53.105695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 344f8883-ac33-4013-ac55-df97655fdf1a] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:53.112008 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:53.112458 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:53.113282 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:53.113721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:53.127376 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a HTTP/1.1 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:53.128961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.130593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '344f8883-ac33-4013-ac55-df97655fdf1a'} Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:53.131833 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. Jun 24 23:55:53.133575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:53.135444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 344f8883-ac33-4013-ac55-df97655fdf1a could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:53.135444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8eab778b-8f1a-484c-96ef-69a5a6bd247e tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a" status: 404 len: 111 microversion: 2.1 time: 0.030377 Jun 24 23:55:53.135444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 481/980] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:53 2022] GET /compute/v2.1/servers/344f8883-ac33-4013-ac55-df97655fdf1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:54.085716 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:54.086225 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:54.093561 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.094011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.094779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.095215 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.109876 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 HTTP/1.1 Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:54.111444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.112927 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '4266fe95-e867-4be8-a5c5-8f60b19e1cb6'} Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:54.113806 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.115286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.117124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:54.117124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-de7b526a-d27c-46ee-8f42-627812427f1e tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 404 len: 111 microversion: 2.1 time: 0.030951 Jun 24 23:55:54.117124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 500/981] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:54 2022] DELETE /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:54.121303 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:54.121925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] [instance: 4266fe95-e867-4be8-a5c5-8f60b19e1cb6] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:54.128436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.128925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.129695 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.130138 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.144348 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] HTTP exception thrown: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Request method failure captured: Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 HTTP/1.1 Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1n0HSbDOQ4nitwd8Ss2VSVGTCQL5LLjRCFxsFld4rm65J1CuQgN0AykCLtaZY2roWptAL2sYzVRsmc0MaDHoniqp9CZ-3C2mExuDi9yjT1b97b0wFKQn70Sghm-0tEkl-NCzKQtAmS18Tcmhw0QlT6KZR_EEYAT0PbEbvGUERxxhI Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:54.145910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_040134c568aa46c09ca9e5b077cc5d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/040134c568aa46c09ca9e5b077cc5d3c"}]}] Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 040134c568aa46c09ca9e5b077cc5d3c Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1288451068 Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 04e35f840ef045f0b44fab3e57a1a3c8 Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeNegativeTest-1288451068-project Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.147415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '4266fe95-e867-4be8-a5c5-8f60b19e1cb6'} Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:54.148158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. Jun 24 23:55:54.149593 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.151035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] Returning 404 to user: Instance 4266fe95-e867-4be8-a5c5-8f60b19e1cb6 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:54.151035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e274db53-8609-4751-b626-3450af99494a tempest-AttachVolumeNegativeTest-1288451068 tempest-AttachVolumeNegativeTest-1288451068-project] 10.222.0.47 "GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6" status: 404 len: 111 microversion: 2.1 time: 0.029837 Jun 24 23:55:54.151035 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 482/982] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:54 2022] GET /compute/v2.1/servers/4266fe95-e867-4be8-a5c5-8f60b19e1cb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:54.274737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:54.275226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:54.283682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.284694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.285696 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.286308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.301367 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 HTTP/1.1 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:55:54.304286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.305742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5'} Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:54.306499 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.307711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.309007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:54.309007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-6622bfe2-e5a9-4966-8ab5-e688869cdedd tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 404 len: 111 microversion: 2.1 time: 0.035114 Jun 24 23:55:54.309007 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 501/983] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:55:54 2022] DELETE /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:54.314495 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:54.315468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] [instance: 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:54.322702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.324139 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.325201 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:54.325887 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:54.342431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] HTTP exception thrown: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Request method failure captured: Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 HTTP/1.1 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1gdhF0lnOijczvuVECRS7_PxyeEpk70D7eNGvyboQoDmRrTFwUaIlo1Ecsq9bbXZ5UbiSuQKTwyEGne3zJMaONLqbW5w383GbZs9EnCdSopbXHaXDP2liaqYThCcRtXYBc7mJMyojkzbYfKCZf55gdC3DOJ3q0ChfoEsIpfPFv_r0 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:55:54.344124 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a779b000010c4549989d8a8f25e8b1be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a779b000010c4549989d8a8f25e8b1be"}]}] Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: a779b000010c4549989d8a8f25e8b1be Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeTestJSON-47774814 Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 927ffbcd7078473f97f42bdb54acf57e Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeTestJSON-47774814-project Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.345737 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5'} Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:55:54.349338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. Jun 24 23:55:54.350510 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:55:54.351562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] Returning 404 to user: Instance 5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:55:54.351562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8ba0beca-5dc0-4fa4-abe5-b6cae9f402c1 tempest-AttachVolumeTestJSON-47774814 tempest-AttachVolumeTestJSON-47774814-project] 10.222.0.47 "GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5" status: 404 len: 111 microversion: 2.1 time: 0.034992 Jun 24 23:55:54.351562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 483/984] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:55:54 2022] GET /compute/v2.1/servers/5fbe9e00-90a9-4ac3-a536-4d8d0340b1a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:55:58.607659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:58.609185 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:58.619119 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.621222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:58.622371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.622975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:58.689634 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3716fe56-da34-4ebf-b460-467529355dd8 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089182 Jun 24 23:55:58.696124 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 502/985] 10.222.0.47 () {60 vars in 1342 bytes} [Fri Jun 24 23:55:58 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:55:58.794425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:58.794910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:58.806292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.806749 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:58.807774 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.808206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:58.850183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:55:58.968216 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ff0ece4c-a6ad-495a-8bf7-7dda7c69f9d1 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 204 len: 0 microversion: 2.20 time: 0.177666 Jun 24 23:55:58.969306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 484/986] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Jun 24 23:55:58 2022] DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 23:55:58.981684 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:55:58.982763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:55:58.990873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.991740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:58.993217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:55:58.994179 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:55:59.238253 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:59.265420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:59.270496 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:55:59.272015 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e74dd9a1-42b9-42ac-856a-3595e14a680d tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.298127 Jun 24 23:55:59.282033 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 503/987] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:55:58 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 23:56:00.292850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:00.294077 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:00.300770 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:00.301233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:00.302011 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:00.302454 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:00.480818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:00.488905 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:00.490564 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:00.492195 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b1a0a918-3dd7-4486-b24d-7b789aaa30fa tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1724 microversion: 2.20 time: 0.204320 Jun 24 23:56:00.493502 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 485/988] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:56:00 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:56:01.300075 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-50735e69-bda6-4026-85fa-9a8ed2bb05a6 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Action: 'create', calling method: .version_select at 0x7f7a5a3fbb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1840334207", "metadata": {"Type": "work"}}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-50735e69-bda6-4026-85fa-9a8ed2bb05a6 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 122 Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:01.326979 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1840334207", "metadata": {"Type": "work"}}} Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:01.328757 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1840334207', 'metadata': {'Type': 'work'}}}} Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise error Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.331137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 23:56:01.332440 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 23:56:01.333622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 23:56:01.333622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.333622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-50735e69-bda6-4026-85fa-9a8ed2bb05a6 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.333622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-50735e69-bda6-4026-85fa-9a8ed2bb05a6 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.268919 Jun 24 23:56:01.333622 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 504/989] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Jun 24 23:56:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:01.341114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-206320a1-264d-4db3-bd41-5121754c849e tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Action: 'create', calling method: .version_select at 0x7f7a55a76790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-228953336", "metadata": {"Type": "work"}}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-206320a1-264d-4db3-bd41-5121754c849e tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 119 Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:01.344619 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-228953336", "metadata": {"Type": "work"}}} Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: Jun 24 23:56:01.346273 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-228953336', 'metadata': {'Type': 'work'}}}} Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise error Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi '0' Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.347246 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 23:56:01.349036 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 23:56:01.351415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 23:56:01.351415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.351415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-206320a1-264d-4db3-bd41-5121754c849e tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.351415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-206320a1-264d-4db3-bd41-5121754c849e tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013488 Jun 24 23:56:01.351415 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 486/990] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Jun 24 23:56:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:01.362002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-922742e2-15f3-4595-ad4b-0fa310e32f0b tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Action: 'create', calling method: .version_select at 0x7f7a55a78820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-45532835", "metadata": {"Type": "work"}}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-922742e2-15f3-4595-ad4b-0fa310e32f0b tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 117 Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:01.365389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-45532835", "metadata": {"Type": "work"}}} Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:01.366695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-45532835', 'metadata': {'Type': 'work'}}}} Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise error Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi '' Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.367462 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 23:56:01.369238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 23:56:01.371665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 23:56:01.371665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.371665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-922742e2-15f3-4595-ad4b-0fa310e32f0b tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.371665 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-922742e2-15f3-4595-ad4b-0fa310e32f0b tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008694 Jun 24 23:56:01.387017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2df5bf74-28a1-4a26-831e-ba2ca5c5404a tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Calling method '.version_select at 0x7f7a55b58790>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:01.397018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 505/991] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Jun 24 23:56:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:01.429550 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-35a0e086-99ab-47cc-9a63-33950abd01fc req-0cd8b679-8b5c-43a3-99e8-38339491d68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166dbee0-b4e5-4031-a9e1-15e6a51f137c", "name": "network-vif-deleted", "tag": "1f1f932f-5c23-4d7b-a743-00332aa12a6a"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:01.439560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-35a0e086-99ab-47cc-9a63-33950abd01fc req-0cd8b679-8b5c-43a3-99e8-38339491d68a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:01.440329 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-35a0e086-99ab-47cc-9a63-33950abd01fc req-0cd8b679-8b5c-43a3-99e8-38339491d68a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:01.454096 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-35a0e086-99ab-47cc-9a63-33950abd01fc req-0cd8b679-8b5c-43a3-99e8-38339491d68a service nova] Creating event network-vif-deleted:1f1f932f-5c23-4d7b-a743-00332aa12a6a for instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c on hv-cinder-84762 Jun 24 23:56:01.460697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-35a0e086-99ab-47cc-9a63-33950abd01fc req-0cd8b679-8b5c-43a3-99e8-38339491d68a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Jun 24 23:56:01.461296 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 506/992] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:56:01.478235 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-2df5bf74-28a1-4a26-831e-ba2ca5c5404a tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] HTTP exception thrown: Volume tempest-invalid-1988916832 could not be found. Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2df5bf74-28a1-4a26-831e-ba2ca5c5404a tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1988916832 HTTP/1.1 Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:01.485496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Volume tempest-invalid-1988916832 could not be found. Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'tempest-invalid-1988916832'} Jun 24 23:56:01.486981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1988916832 could not be found. (HTTP 404) (Request-ID: req-e8ba286f-9d64-4928-b7bc-0a2a1d87e9e5) Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.488206 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:01.489436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1988916832 could not be found. Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:01.490595 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1988916832 could not be found. Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1988916832 could not be found. Jun 24 23:56:01.492059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.494290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2df5bf74-28a1-4a26-831e-ba2ca5c5404a tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 404 to user: Volume tempest-invalid-1988916832 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.497604 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2df5bf74-28a1-4a26-831e-ba2ca5c5404a tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1988916832" status: 404 len: 99 microversion: 2.1 time: 0.118169 Jun 24 23:56:01.498408 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 487/993] 10.222.0.47 () {58 vars in 1217 bytes} [Fri Jun 24 23:56:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1988916832 => generated 99 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 23:56:01.511639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-08427a61-b18f-44b5-9b82-94de3c60ed1f tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006358 Jun 24 23:56:01.512147 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 507/994] 10.222.0.47 () {58 vars in 1139 bytes} [Fri Jun 24 23:56:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 24 23:56:01.523141 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5ec84055-2111-4a93-ae2c-fd9fcf50993b tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003814 Jun 24 23:56:01.523791 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:01.524089 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 508/995] 10.222.0.47 () {58 vars in 1136 bytes} [Fri Jun 24 23:56:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 23:56:01.531403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:01.534999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3a22ad82-bce1-452f-b046-6dc059158b46 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Calling method '.version_select at 0x7f7a55acd9d0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:01.539402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:01.539956 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:01.540869 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:01.541359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:01.610161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-3a22ad82-bce1-452f-b046-6dc059158b46 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] HTTP exception thrown: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3a22ad82-bce1-452f-b046-6dc059158b46 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/os-volumes/722e0525-9708-47e1-86e3-6f5bb9828d0e HTTP/1.1 Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:01.615170 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '722e0525-9708-47e1-86e3-6f5bb9828d0e'} Jun 24 23:56:01.616657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. (HTTP 404) (Request-ID: req-a371994b-644d-4b33-8522-4873801c0594) Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.617472 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:01.618666 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 23:56:01.619807 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3a22ad82-bce1-452f-b046-6dc059158b46 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 404 to user: Volume 722e0525-9708-47e1-86e3-6f5bb9828d0e could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3a22ad82-bce1-452f-b046-6dc059158b46 tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/722e0525-9708-47e1-86e3-6f5bb9828d0e" status: 404 len: 109 microversion: 2.1 time: 0.086472 Jun 24 23:56:01.621062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 509/996] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:56:01 2022] DELETE /compute/v2.1/os-volumes/722e0525-9708-47e1-86e3-6f5bb9828d0e => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 23:56:01.629980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a4a830b2-7c19-431d-8fb0-f8df3731466d tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Calling method '.version_select at 0x7f7a55acd3a0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:01.702762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-a4a830b2-7c19-431d-8fb0-f8df3731466d tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] HTTP exception thrown: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a4a830b2-7c19-431d-8fb0-f8df3731466d tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Request method failure captured: Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/os-volumes/cd73251b-b20e-48ee-bf1f-28e1349d64ed HTTP/1.1 Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8QqK4HYA2GOSnh77KVWLr_aJKN_2FwS2T0nVybXRwH4lw6Xgdm3zjQcxw0fdzhsMOQTIBcNXGyAGiL2_WCjCj8Qo_vzA3YfvrO_7dq34zzSQrM-xtNtsoxXwXWwjKEYtcQZFXGJGVID3O_fkLvFFj-0kXLX0mG__MXI1TFDWf6LUg Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:01.705729 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ac4f723b896943248837d999142f413b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ac4f723b896943248837d999142f413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ac4f723b896943248837d999142f413b"}]}] Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: ac4f723b896943248837d999142f413b Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesNegativeTest-643453662 Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: e70c8b99aa814154acff411cf355a3bb Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesNegativeTest-643453662-project Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'cd73251b-b20e-48ee-bf1f-28e1349d64ed'} Jun 24 23:56:01.707374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. (HTTP 404) (Request-ID: req-781c52e9-aec5-43ad-8959-706a43aea376) Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.708337 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:01.711136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 23:56:01.714909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a4a830b2-7c19-431d-8fb0-f8df3731466d tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] Returning 404 to user: Volume cd73251b-b20e-48ee-bf1f-28e1349d64ed could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:01.716061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a4a830b2-7c19-431d-8fb0-f8df3731466d tempest-VolumesNegativeTest-643453662 tempest-VolumesNegativeTest-643453662-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/cd73251b-b20e-48ee-bf1f-28e1349d64ed" status: 404 len: 109 microversion: 2.1 time: 0.082312 Jun 24 23:56:01.720011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 510/997] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:01 2022] GET /compute/v2.1/os-volumes/cd73251b-b20e-48ee-bf1f-28e1349d64ed => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:56:01.723009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:01.746964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:01.756393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e78cf97bac4484f93c7359b86a26628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf88e235fa45d1b92c7c5612bfe140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:01.758117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-bd3f26ad-a18d-4247-9d50-35d801d5b46b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 200 len: 1367 microversion: 2.20 time: 0.247298 Jun 24 23:56:01.760846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 488/998] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:56:01 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 23:56:02.778419 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:02.779262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:02.793809 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:02.794590 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:02.795643 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:02.800908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:02.824011 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c HTTP/1.1 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:02.833048 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:02.834902 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '166dbee0-b4e5-4031-a9e1-15e6a51f137c'} Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:02.835758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:02.837262 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:02.843850 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:02.844859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ddca10b1-1b59-48a7-a2d9-f099ab0f8d86 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 404 len: 111 microversion: 2.20 time: 0.071454 Jun 24 23:56:02.845618 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 511/999] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:56:02 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:02.854209 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0e6334ed-77eb-471f-b69d-f1799cdba285 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '.version_select at 0x7f7a55a04430>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:02.886002 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0e6334ed-77eb-471f-b69d-f1799cdba285 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320671373" status: 204 len: 0 microversion: 2.20 time: 0.034774 Jun 24 23:56:02.887079 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 489/1000] 10.222.0.47 () {60 vars in 1261 bytes} [Fri Jun 24 23:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320671373 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 23:56:05.024502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:05.025594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:05.032834 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:05.033502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:05.034354 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:05.034786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:05.037975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:56:05.052123 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c HTTP/1.1 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:05.054534 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.056068 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '166dbee0-b4e5-4031-a9e1-15e6a51f137c'} Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:05.057784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.059156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.060372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:05.060372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-35262273-3f9e-4046-a530-27182dbc373f tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 404 len: 111 microversion: 2.20 time: 0.040499 Jun 24 23:56:05.061244 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 512/1001] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Jun 24 23:56:05 2022] DELETE /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:05.071966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:05.073806 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: 166dbee0-b4e5-4031-a9e1-15e6a51f137c] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:05.076116 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:56:05.085228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:05.085864 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:05.086679 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:05.087120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:05.103034 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c HTTP/1.1 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:05.105299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.106702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '166dbee0-b4e5-4031-a9e1-15e6a51f137c'} Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:05.107489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. Jun 24 23:56:05.108752 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:05.110453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance 166dbee0-b4e5-4031-a9e1-15e6a51f137c could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:05.112653 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-15bf3601-21b3-4a9b-906f-7ad4f27afac2 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c" status: 404 len: 111 microversion: 2.20 time: 0.047405 Jun 24 23:56:05.113290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 490/1002] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:56:05 2022] GET /compute/v2.1/servers/166dbee0-b4e5-4031-a9e1-15e6a51f137c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:06.279517 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:06.280251 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:06.299607 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:06.300142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:06.305180 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:06.309892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:06.342247 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 HTTP/1.1 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:06.347371 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.348875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'cb534158-a606-4d20-89de-2c7c5cbfa9a7'} Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:06.349648 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.351136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.355351 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:06.359904 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ead3dec2-f601-4fa2-9714-a4a32d058a2b tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 404 len: 111 microversion: 2.20 time: 0.081984 Jun 24 23:56:06.361642 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 513/1003] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Jun 24 23:56:06 2022] DELETE /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:06.370281 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:06.370915 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] [instance: cb534158-a606-4d20-89de-2c7c5cbfa9a7] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:06.383231 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:06.383998 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:06.386681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:06.390292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:06.414757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] HTTP exception thrown: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Request method failure captured: Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 HTTP/1.1 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk1eO1X_FFdGDX5ZSTMi_WVqvSYEAKQF0_c55jGNwv_uqz-yC24RMJPUUUVo6wADcusWD7H1hDY311DqPABMijrFlntLymZJy35cX67pLYP2fD-T0ctS2VFglaDZFtz0mBILpC6k9dlWKTFMnLR1AiyoswXbzAqzrGTNUenbTELaqmk Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:06.417157 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ccf88e235fa45d1b92c7c5612bfe140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ccf88e235fa45d1b92c7c5612bfe140"}]}] Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 5ccf88e235fa45d1b92c7c5612bfe140 Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1113088902 Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 2e78cf97bac4484f93c7359b86a26628 Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1113088902-project Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.418937 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'cb534158-a606-4d20-89de-2c7c5cbfa9a7'} Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:06.420102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. Jun 24 23:56:06.421646 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:06.429618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] Returning 404 to user: Instance cb534158-a606-4d20-89de-2c7c5cbfa9a7 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:06.430498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1ac0e086-d95a-446b-af74-c5337bb2d162 tempest-AttachVolumeShelveTestJSON-1113088902 tempest-AttachVolumeShelveTestJSON-1113088902-project] 10.222.0.47 "GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7" status: 404 len: 111 microversion: 2.20 time: 0.064341 Jun 24 23:56:06.435120 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 491/1004] 10.222.0.47 () {60 vars in 1276 bytes} [Fri Jun 24 23:56:06 2022] GET /compute/v2.1/servers/cb534158-a606-4d20-89de-2c7c5cbfa9a7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 23:56:12.195454 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:12.196695 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:12.210066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:12.212291 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:12.215264 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:12.215986 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:12.222143 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-12b7ee32-6b2b-4c18-99e7-661e69a20048 req-727384e0-78d7-461a-ae3f-e5032ad76ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:12.233292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-12b7ee32-6b2b-4c18-99e7-661e69a20048 req-727384e0-78d7-461a-ae3f-e5032ad76ba9 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:12.233731 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-12b7ee32-6b2b-4c18-99e7-661e69a20048 req-727384e0-78d7-461a-ae3f-e5032ad76ba9 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:12.249681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-12b7ee32-6b2b-4c18-99e7-661e69a20048 req-727384e0-78d7-461a-ae3f-e5032ad76ba9 service nova] Creating event network-changed:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:56:12.254638 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Going to try to terminate instance {{(pid=124092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:56:12.256553 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-12b7ee32-6b2b-4c18-99e7-661e69a20048 req-727384e0-78d7-461a-ae3f-e5032ad76ba9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037080 Jun 24 23:56:12.257681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 492/1005] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:12.429580 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b4e2abc9-397d-4303-9798-8fc1817ce887 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 204 len: 0 microversion: 2.1 time: 0.237176 Jun 24 23:56:12.430453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 514/1006] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:56:12 2022] DELETE /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:56:12.442871 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:12.444759 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:12.455977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:12.457686 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:12.459504 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:12.459968 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:12.669190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:12.695739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-c0494e09-df8c-447e-a75a-1b88b9d3922f tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.259548 Jun 24 23:56:12.698767 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 493/1007] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:56:12 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:56:13.685456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2c87282f-e3a7-4ee6-bd02-350b5d764ba4 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Action: 'create', calling method: .version_select at 0x7f7a5a3fb820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1323621749"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:13.721930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:13.725369 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:13.742763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:13.750397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:13.753963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:13.760135 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:13.996547 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:14.012211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7edaec38-85f6-4ec1-bfc1-ade7f59ae4c7 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1570 microversion: 2.1 time: 0.299921 Jun 24 23:56:14.022700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 494/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:56:13 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:56:14.155961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2c87282f-e3a7-4ee6-bd02-350b5d764ba4 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.752555 Jun 24 23:56:14.156569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 515/1009] 10.222.0.47 () {60 vars in 1154 bytes} [Fri Jun 24 23:56:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 754 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 23:56:14.169168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fb4d1f61-286c-4e71-adfa-6d6c92e2f834 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55b58040>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:14.226685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fb4d1f61-286c-4e71-adfa-6d6c92e2f834 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 200 len: 345 microversion: 2.1 time: 0.062984 Jun 24 23:56:14.227251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 495/1010] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:14 2022] GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:14.831552 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-9cf105e8-4a7c-443b-a346-97da046bbfa2 req-2907b781-73ff-4618-96b4-e56253773820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5435298-6b0b-457c-bdb7-be68874c9e86", "name": "network-vif-deleted", "tag": "af04daf3-acb2-4447-82f1-cd3cfeaf4e43"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:14.842609 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-9cf105e8-4a7c-443b-a346-97da046bbfa2 req-2907b781-73ff-4618-96b4-e56253773820 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:14.843102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-9cf105e8-4a7c-443b-a346-97da046bbfa2 req-2907b781-73ff-4618-96b4-e56253773820 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:14.855118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-9cf105e8-4a7c-443b-a346-97da046bbfa2 req-2907b781-73ff-4618-96b4-e56253773820 service nova] Creating event network-vif-deleted:af04daf3-acb2-4447-82f1-cd3cfeaf4e43 for instance e5435298-6b0b-457c-bdb7-be68874c9e86 on hv-cinder-84762 Jun 24 23:56:14.860455 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-9cf105e8-4a7c-443b-a346-97da046bbfa2 req-2907b781-73ff-4618-96b4-e56253773820 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Jun 24 23:56:14.861121 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 516/1011] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:15.037921 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:15.039232 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:15.046285 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:15.046739 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:15.047505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:15.047938 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:15.069087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:56:15.119642 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faba3540b1b4ef5a533ab0ff8e1cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e318cfdc9de345148828c09515cecdc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:56:15.131763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8429324f-26d9-4dbb-97b2-313fd77ac9a1 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 200 len: 1219 microversion: 2.1 time: 0.104768 Jun 24 23:56:15.132545 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 496/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:56:15 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:56:15.242012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e335e213-bb63-44ab-af66-254fe5605d8d tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a5a3d1e50>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:15.323228 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e335e213-bb63-44ab-af66-254fe5605d8d tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 200 len: 346 microversion: 2.1 time: 0.085926 Jun 24 23:56:15.323795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 517/1013] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:15 2022] GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:15.336409 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4782b067-cda7-4233-91c7-6b85f5db8f6a tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Action: 'create', calling method: .version_select at 0x7f7a55a761f0>, body: {"snapshot": {"volume_id": "0720c745-9e47-4d75-9036-75ed687a18de", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-733577269"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:56:15.512656 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4782b067-cda7-4233-91c7-6b85f5db8f6a tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.181259 Jun 24 23:56:15.513275 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 497/1014] 10.222.0.47 () {60 vars in 1161 bytes} [Fri Jun 24 23:56:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:15.523180 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-26207b18-c05f-4fab-a295-b15c6e5e9c2d tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55bad310>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:15.561396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-26207b18-c05f-4fab-a295-b15c6e5e9c2d tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 286 microversion: 2.1 time: 0.041914 Jun 24 23:56:15.562044 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 518/1015] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:15 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:15.571952 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1b2b6ad8-e40f-4122-ba51-e42ee21c2424 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55bbf0d0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:15.606618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1b2b6ad8-e40f-4122-ba51-e42ee21c2424 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038340 Jun 24 23:56:15.607207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 498/1016] 10.222.0.47 () {58 vars in 1139 bytes} [Fri Jun 24 23:56:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:15.617084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-16ec3342-717c-4c96-9101-a684002d62bd tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55badee0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:15.651583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-16ec3342-717c-4c96-9101-a684002d62bd tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 286 microversion: 2.1 time: 0.038218 Jun 24 23:56:15.652164 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 519/1017] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:15 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:16.155083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:16.155083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] [instance: e5435298-6b0b-457c-bdb7-be68874c9e86] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:56:16.161435 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:16.162000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:16.162882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:56:16.163446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:56:16.182446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] HTTP exception thrown: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Request method failure captured: Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 HTTP/1.1 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk3HZtPZtyBwP-hh4UfVtQ6WBx4sbEn6A_pwl59R4BzZ8Y27Din-OXgp7OL81KIU6u8jdHFFLQp7fKO_Vn2GAB4VRgc7f2B1lKprjcvXPZcQcorPbgKTW5G5hdPnVvD7JbKVBQldNhnmRd-jWbRBYx_Yvg6NiGwuWENc0L3xqfC2aWI Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: e318cfdc9de345148828c09515cecdc1 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-TestShelveInstance-445606227 Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:16.184220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e318cfdc9de345148828c09515cecdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e318cfdc9de345148828c09515cecdc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e318cfdc9de345148828c09515cecdc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e318cfdc9de345148828c09515cecdc1"}]}] Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-TestShelveInstance-445606227 Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: e318cfdc9de345148828c09515cecdc1 Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-TestShelveInstance-445606227 Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-TestShelveInstance-445606227-project Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 7faba3540b1b4ef5a533ab0ff8e1cca3 Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-TestShelveInstance-445606227-project Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. Jun 24 23:56:16.185851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': 'e5435298-6b0b-457c-bdb7-be68874c9e86'} Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:16.186801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. Jun 24 23:56:16.188336 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:16.190049 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Returning 404 to user: Instance e5435298-6b0b-457c-bdb7-be68874c9e86 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:16.190671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-edd35fae-0540-40fb-a7bb-faa374c60422 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86" status: 404 len: 111 microversion: 2.1 time: 0.044473 Jun 24 23:56:16.191310 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 499/1018] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:56:16 2022] GET /compute/v2.1/servers/e5435298-6b0b-457c-bdb7-be68874c9e86 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:56:16.384117 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fce077ed-79b9-47cf-81bc-5fc537b81874 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] Calling method '.version_select at 0x7f7a55ad1790>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:16.414674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fce077ed-79b9-47cf-81bc-5fc537b81874 tempest-TestShelveInstance-445606227 tempest-TestShelveInstance-445606227-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-890809988" status: 202 len: 0 microversion: 2.1 time: 0.034356 Jun 24 23:56:16.421435 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 520/1019] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-890809988 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:56:16.674220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ce66dfbb-acd9-4d78-9fa8-782471930833 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55bd0790>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:16.713111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ce66dfbb-acd9-4d78-9fa8-782471930833 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 286 microversion: 2.1 time: 0.053672 Jun 24 23:56:16.713791 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 500/1020] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:16 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:17.725487 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0c7b2f8b-2240-4400-aec4-9782d9d82402 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55c0baf0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:17.761327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0c7b2f8b-2240-4400-aec4-9782d9d82402 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 286 microversion: 2.1 time: 0.039979 Jun 24 23:56:17.761989 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 521/1021] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:17 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:18.774812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4e0115d1-8d9b-42bf-9fbe-d2a11e100a38 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55a764c0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:18.809080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4e0115d1-8d9b-42bf-9fbe-d2a11e100a38 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 287 microversion: 2.1 time: 0.039124 Jun 24 23:56:18.809831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 501/1022] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:18 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:18.822191 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-831c9926-1256-4dbb-9931-fa2473e6d233 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55acd310>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:18.887097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-831c9926-1256-4dbb-9931-fa2473e6d233 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 202 len: 0 microversion: 2.1 time: 0.069888 Jun 24 23:56:18.887912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 522/1023] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Jun 24 23:56:18 2022] DELETE /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 23:56:18.897208 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5064d54c-ef38-4621-8bd9-15929f241f18 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55a4b8b0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:18.929851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5064d54c-ef38-4621-8bd9-15929f241f18 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 200 len: 286 microversion: 2.1 time: 0.037102 Jun 24 23:56:18.930465 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 502/1024] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:18 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:56:19.945690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b16e48a4-b8b5-4dec-bea6-83219ca17a3e tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a5a3fbca0>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:19.978370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-b16e48a4-b8b5-4dec-bea6-83219ca17a3e tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] HTTP exception thrown: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b16e48a4-b8b5-4dec-bea6-83219ca17a3e tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Request method failure captured: Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f HTTP/1.1 Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8dMU94TIC6UBvRYDQe8qLEXZ0POJeBg-3r7lnfEJp5SwIpe-Tw8N8b1D8kjqnxhz0VfmhmGQFh6UkfePROse-lnYKEt6crgQtVva9XaqITfRB1DxUEFbQR7l9wC2AT-ReI2gdeoKTic9p3MJhVOySY7w0lOx-kghR5yXwvT2-03io Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:19.984216 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_46f447736b9243bf96804fdbe7e194da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}] Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 8204dee5ba6e4049b0bb25f0389cb4e8 Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'e556b16f-beab-48d7-8d83-ac4a99031f6f'} Jun 24 23:56:19.985812 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. (HTTP 404) (Request-ID: req-b3eab97a-a43b-4df2-82dd-68854ee024f9) Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.986704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:19.987854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 23:56:19.989066 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. Jun 24 23:56:19.990429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:19.993516 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b16e48a4-b8b5-4dec-bea6-83219ca17a3e tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Returning 404 to user: Snapshot e556b16f-beab-48d7-8d83-ac4a99031f6f could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:19.995102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b16e48a4-b8b5-4dec-bea6-83219ca17a3e tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f" status: 404 len: 111 microversion: 2.1 time: 0.056067 Jun 24 23:56:19.995735 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 523/1025] 10.222.0.47 () {58 vars in 1250 bytes} [Fri Jun 24 23:56:19 2022] GET /compute/v2.1/os-snapshots/e556b16f-beab-48d7-8d83-ac4a99031f6f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:56:20.011702 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fd33b0a8-c315-4f99-b308-503e81570fdf tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55ae8af0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:20.115172 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fd33b0a8-c315-4f99-b308-503e81570fdf tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 202 len: 0 microversion: 2.1 time: 0.113965 Jun 24 23:56:20.116793 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 503/1026] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:56:19 2022] DELETE /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:56:20.124217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-becc9d5b-5563-4350-bbc4-ce6693fa2bc9 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55badf70>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:20.180501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-becc9d5b-5563-4350-bbc4-ce6693fa2bc9 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 200 len: 345 microversion: 2.1 time: 0.060007 Jun 24 23:56:20.181099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 524/1027] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:20 2022] GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:56:21.195076 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ce3b89b4-5dd2-46a6-af87-b282dc4703cc tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55a761f0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:21.223645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-ce3b89b4-5dd2-46a6-af87-b282dc4703cc tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] HTTP exception thrown: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ce3b89b4-5dd2-46a6-af87-b282dc4703cc tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Request method failure captured: Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de HTTP/1.1 Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk8dMU94TIC6UBvRYDQe8qLEXZ0POJeBg-3r7lnfEJp5SwIpe-Tw8N8b1D8kjqnxhz0VfmhmGQFh6UkfePROse-lnYKEt6crgQtVva9XaqITfRB1DxUEFbQR7l9wC2AT-ReI2gdeoKTic9p3MJhVOySY7w0lOx-kghR5yXwvT2-03io Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:21.226114 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_46f447736b9243bf96804fdbe7e194da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}] Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 8204dee5ba6e4049b0bb25f0389cb4e8 Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '0720c745-9e47-4d75-9036-75ed687a18de'} Jun 24 23:56:21.227632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. (HTTP 404) (Request-ID: req-e27e5020-c4e3-4af2-97c9-bd67a8fe630a) Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.229247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:21.230583 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 23:56:21.231873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ce3b89b4-5dd2-46a6-af87-b282dc4703cc tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Returning 404 to user: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ce3b89b4-5dd2-46a6-af87-b282dc4703cc tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 404 len: 109 microversion: 2.1 time: 0.037645 Jun 24 23:56:21.233312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 504/1028] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:21 2022] GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:56:21.246217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e4c8210c-157a-49ee-a87a-a739b1c26400 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55a78700>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:21.273948 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-e4c8210c-157a-49ee-a87a-a739b1c26400 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] HTTP exception thrown: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e4c8210c-157a-49ee-a87a-a739b1c26400 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Request method failure captured: Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de HTTP/1.1 Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk8dMU94TIC6UBvRYDQe8qLEXZ0POJeBg-3r7lnfEJp5SwIpe-Tw8N8b1D8kjqnxhz0VfmhmGQFh6UkfePROse-lnYKEt6crgQtVva9XaqITfRB1DxUEFbQR7l9wC2AT-ReI2gdeoKTic9p3MJhVOySY7w0lOx-kghR5yXwvT2-03io Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:56:21.276097 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_46f447736b9243bf96804fdbe7e194da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}] Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: 8204dee5ba6e4049b0bb25f0389cb4e8 Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '0720c745-9e47-4d75-9036-75ed687a18de'} Jun 24 23:56:21.278222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. (HTTP 404) (Request-ID: req-6e17bec1-9a63-4c70-a022-13dde2ad1795) Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.279911 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 23:56:21.282084 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 23:56:21.283617 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e4c8210c-157a-49ee-a87a-a739b1c26400 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Returning 404 to user: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e4c8210c-157a-49ee-a87a-a739b1c26400 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 404 len: 109 microversion: 2.1 time: 0.036226 Jun 24 23:56:21.284982 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 525/1029] 10.222.0.47 () {58 vars in 1247 bytes} [Fri Jun 24 23:56:21 2022] DELETE /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:56:21.286645 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5023f3fa-c94d-4163-ad46-51a8555e9a01 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Calling method '.version_select at 0x7f7a55b58820>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:56:21.318828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-5023f3fa-c94d-4163-ad46-51a8555e9a01 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] HTTP exception thrown: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5023f3fa-c94d-4163-ad46-51a8555e9a01 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Request method failure captured: Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de HTTP/1.1 Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk8dMU94TIC6UBvRYDQe8qLEXZ0POJeBg-3r7lnfEJp5SwIpe-Tw8N8b1D8kjqnxhz0VfmhmGQFh6UkfePROse-lnYKEt6crgQtVva9XaqITfRB1DxUEFbQR7l9wC2AT-ReI2gdeoKTic9p3MJhVOySY7w0lOx-kghR5yXwvT2-03io Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 24 23:56:21.320801 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/46f447736b9243bf96804fdbe7e194da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_46f447736b9243bf96804fdbe7e194da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/46f447736b9243bf96804fdbe7e194da"}]}] Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: 46f447736b9243bf96804fdbe7e194da Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-229940094 Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: 8204dee5ba6e4049b0bb25f0389cb4e8 Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-VolumesSnapshotsTestJSON-229940094-project Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '0720c745-9e47-4d75-9036-75ed687a18de'} Jun 24 23:56:21.323374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. (HTTP 404) (Request-ID: req-3b158cbf-e2c4-43ac-ad95-0a49c0775c75) Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.324186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 23:56:21.325404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 23:56:21.326810 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5023f3fa-c94d-4163-ad46-51a8555e9a01 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] Returning 404 to user: Volume 0720c745-9e47-4d75-9036-75ed687a18de could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5023f3fa-c94d-4163-ad46-51a8555e9a01 tempest-VolumesSnapshotsTestJSON-229940094 tempest-VolumesSnapshotsTestJSON-229940094-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de" status: 404 len: 109 microversion: 2.1 time: 0.040149 Jun 24 23:56:21.328263 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 505/1030] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Jun 24 23:56:21 2022] GET /compute/v2.1/os-volumes/0720c745-9e47-4d75-9036-75ed687a18de => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:57:17.219994 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 23:57:17.220556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Fri Jun 24 23:57:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 23:57:50.235508 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef7a8b77-45a8-4f16-b94e-9474a648fb3f] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 24 23:57:50.236137 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:57:50.236737 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:57:50.241703 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2ff82610-c872-4bb3-9fa8-dc364074529a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'create', calling method: .version_select at 0x7f7a55ad1160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1986054684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtytm7NKActdefu/+vj1SpZWEQSvaVh/n695T1BDHCqcUYps1lVGqipp3v5IVbEa/mh1sVROTcemZJP+ZSoUQam9ZuY+ElgzvQqhiD2es5S8D/77c5tjrUWscEv0RTN/g=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:57:50.260690 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-2ff82610-c872-4bb3-9fa8-dc364074529a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Getting quotas for project cc9f5775196a45df8de41ccff957b6ad. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:57:50.264475 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-2ff82610-c872-4bb3-9fa8-dc364074529a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Getting quotas for user a23c541d3c33423597b22a233d899c36 and project cc9f5775196a45df8de41ccff957b6ad. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:57:50.288969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2ff82610-c872-4bb3-9fa8-dc364074529a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055943 Jun 24 23:57:50.289546 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 526/1031] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:57:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:57:50.337207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=13 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:57:50.337948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=4 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:57:50.342729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-543493433", "imageRef": "99392fe6-cbae-4d7d-8505-6efd472b912d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1986054684", "networks": [{"uuid": "1174c495-baa0-4b25-883c-9ab960dd8637"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:57:50.397988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] validate_networks() for [('1174c495-baa0-4b25-883c-9ab960dd8637', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 23:57:50.771602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 23:57:50.771925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 23:57:50.772410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 23:57:50.772883 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 23:57:50.773388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 23:57:50.783427 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:50.783945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:50.785027 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:50.786111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:50.806185 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Getting quotas for project cc9f5775196a45df8de41ccff957b6ad. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:57:50.811006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Getting quotas for user a23c541d3c33423597b22a233d899c36 and project cc9f5775196a45df8de41ccff957b6ad. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:57:50.824156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 23:57:50.826685 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99392fe6-cbae-4d7d-8505-6efd472b912d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 23:57:50.879819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fd837788-0113-4d5d-a3c5-468f92b9fb66 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544939 Jun 24 23:57:50.880651 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 506/1032] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Jun 24 23:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 23:57:50.890234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-92813fd9-1c7b-4075-a358-00285f3bac2a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:50.890969 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-92813fd9-1c7b-4075-a358-00285f3bac2a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:50.945251 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-92813fd9-1c7b-4075-a358-00285f3bac2a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:50.951928 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-92813fd9-1c7b-4075-a358-00285f3bac2a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1258 microversion: 2.1 time: 0.065635 Jun 24 23:57:50.952641 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 527/1033] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:50 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:51.970463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:51.971700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:51.980142 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:51.980640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:51.981392 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:51.981831 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:52.066377 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:52.077030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3be47717-e0dc-4a27-b9b9-83bb86949a29 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1316 microversion: 2.1 time: 0.111487 Jun 24 23:57:52.077904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 507/1034] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:51 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:53.097276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:53.097958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:53.109768 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:53.110212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:53.110987 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:53.111424 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:53.115375 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef7a8b77-45a8-4f16-b94e-9474a648fb3f] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46016. Jun 24 23:57:53.264968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:53.275078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-89d90c1e-b180-4638-91d0-0aa02a330bc5 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.181520 Jun 24 23:57:53.275977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 528/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:53 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:54.293745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:54.295240 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:54.304479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:54.304988 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:54.305808 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:54.306280 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:54.467449 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:54.475763 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ab4a36b3-b0dc-47a8-b5b3-f030d0810326 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.186969 Jun 24 23:57:54.476322 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 508/1036] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:54 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:55.492941 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:55.494335 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:55.501412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:55.502118 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:55.503049 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:55.503654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:55.642302 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:55.649961 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-75dc7b61-280e-4b0d-9145-f5bc50e63a36 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.160918 Jun 24 23:57:55.659554 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 529/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:55 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:56.668741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:56.669416 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:56.678425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:56.678830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:56.679608 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:56.680042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:56.818835 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:56.826543 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-473900c8-e681-40d0-9138-5c7bd3250f0d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.163133 Jun 24 23:57:56.837618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 509/1038] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:56 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:57.845272 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:57.846754 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:57.856082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:57.856530 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:57.857420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:57.857984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:57.995682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:58.003161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3d320de2-ed30-4940-b382-eb1b54f1190e tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.162984 Jun 24 23:57:58.003708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 530/1039] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:57 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:57:59.019832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:57:59.021067 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:57:59.026581 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:59.027030 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:59.027795 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:57:59.028227 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:57:59.179293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:57:59.187073 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e164b504-14f9-4b5d-a08b-de7742cb768a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.171699 Jun 24 23:57:59.187631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 510/1040] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:57:59 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:00.203511 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:00.204246 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:00.212036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:00.212512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:00.213315 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:00.213753 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:00.357528 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:00.366373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-133698f7-0174-438f-a185-d2196b683c10 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.166069 Jun 24 23:58:00.367418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 531/1041] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:00 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:00.400059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-7aea69ca-affe-4d02-99b0-61dbb5c8d09f req-31caa77a-a5d6-42f2-902c-1e83487d176f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:00.414822 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7aea69ca-affe-4d02-99b0-61dbb5c8d09f req-31caa77a-a5d6-42f2-902c-1e83487d176f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:00.415290 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-7aea69ca-affe-4d02-99b0-61dbb5c8d09f req-31caa77a-a5d6-42f2-902c-1e83487d176f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:00.429676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-7aea69ca-affe-4d02-99b0-61dbb5c8d09f req-31caa77a-a5d6-42f2-902c-1e83487d176f service nova] Creating event network-changed:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:58:00.434954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-7aea69ca-affe-4d02-99b0-61dbb5c8d09f req-31caa77a-a5d6-42f2-902c-1e83487d176f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042534 Jun 24 23:58:00.435554 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 511/1042] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:01.383892 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:01.384506 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:01.386373 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=6 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:01.392473 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:01.392950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:01.393710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:01.394596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:01.528800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:01.536190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-56797dd7-1f89-4a9c-b25d-c3fbdd1596bf tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.156773 Jun 24 23:58:01.536762 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 532/1043] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:01 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:02.552925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:02.553620 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:02.555534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:02.556177 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=6 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:02.562496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:02.562942 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:02.563697 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:02.564130 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:02.690526 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:02.698537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3e98f917-75ee-4d93-8fd9-901e1a57e829 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.150018 Jun 24 23:58:02.699086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 512/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:02 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:03.715212 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:03.715819 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:03.722136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:03.722579 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:03.723649 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:03.724214 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:03.862202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:03.877736 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-42c710be-b4ff-47f5-8eae-bd474adf00b2 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.166258 Jun 24 23:58:03.878316 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 533/1045] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:03 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:04.896511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:04.897178 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:04.903634 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:04.904085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:04.904907 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:04.905344 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:05.035667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:05.043670 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-754d91aa-35e6-491b-ac84-9418ac83df5c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.151785 Jun 24 23:58:05.044230 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 513/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:04 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:05.275434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-eaebaea7-d7dc-4028-a44d-a8f61e68d764 req-61ccce62-7049-4c4a-bb64-a2b7d144821f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "name": "network-vif-plugged", "status": "completed", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:05.284621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-eaebaea7-d7dc-4028-a44d-a8f61e68d764 req-61ccce62-7049-4c4a-bb64-a2b7d144821f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:05.284621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-eaebaea7-d7dc-4028-a44d-a8f61e68d764 req-61ccce62-7049-4c4a-bb64-a2b7d144821f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:05.296811 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-eaebaea7-d7dc-4028-a44d-a8f61e68d764 req-61ccce62-7049-4c4a-bb64-a2b7d144821f service nova] Creating event network-vif-plugged:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:58:05.302438 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-eaebaea7-d7dc-4028-a44d-a8f61e68d764 req-61ccce62-7049-4c4a-bb64-a2b7d144821f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030077 Jun 24 23:58:05.303012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 534/1047] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:06.061496 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:06.062113 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:06.069168 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:06.069627 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:06.070393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:06.070830 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:06.203523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:06.211200 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-23311b49-d6de-4a3a-84dc-85f5de9200a0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1358 microversion: 2.1 time: 0.153583 Jun 24 23:58:06.211750 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 514/1048] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:06 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:07.228999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:07.229652 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:07.235803 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.236259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.237061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.237495 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.366489 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:07.373953 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-32fd5d1f-8cad-4434-9dcd-33b70e4d343b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1549 microversion: 2.1 time: 0.150381 Jun 24 23:58:07.374509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 535/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:07 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:07.390080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:07.390700 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:07.397515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.397971 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.398747 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.399188 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.537337 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:07.544667 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e8630f28-283d-4cbf-b37a-d8f46a2d32c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1549 microversion: 2.1 time: 0.158382 Jun 24 23:58:07.545214 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 515/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:07 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:07.560972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:07.564306 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:07.565090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Searching by: {'deleted': False, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad'} {{(pid=124092) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 23:58:07.571972 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.572415 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.573227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.573657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.663826 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.multi_cell_list [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124092) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 23:58:07.760240 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-90b6836d-8d6c-4353-94c2-44032b2ad4e9 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202817 Jun 24 23:58:07.760779 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 536/1051] 10.222.0.47 () {58 vars in 1124 bytes} [Fri Jun 24 23:58:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:07.771931 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:07.772575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:07.778754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.779207 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.779981 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:07.780420 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:07.911867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:07.919446 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-141619e8-1f20-4877-9e3e-1e5546761051 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1549 microversion: 2.1 time: 0.151993 Jun 24 23:58:07.920007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 516/1052] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:07 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:09.419776 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a255e9f9-2e19-4ca3-88c3-78fcac20718f"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:09.420883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:09.427751 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:09.428202 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:09.428998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:09.429434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:09.666190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-43433201-f32d-42c3-bd6d-8037455bd715 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250268 Jun 24 23:58:09.666833 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 537/1053] 10.222.0.47 () {60 vars in 1322 bytes} [Fri Jun 24 23:58:09 2022] POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:16.150047 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:16.150637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:16.157225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:16.157671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:16.158437 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:16.158879 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:16.287536 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:16.295402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7bc0ea4a-4a72-4f36-bdb5-be1fadf8c2e7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1595 microversion: 2.1 time: 0.149171 Jun 24 23:58:16.295949 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 517/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:16 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1595 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:18.194797 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:18.199506 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-48eca3b1-16fc-4cc5-b9b5-e13f76d750a4 req-63c23243-d464-424c-9b6f-0b21124855bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:18.208514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-48eca3b1-16fc-4cc5-b9b5-e13f76d750a4 req-63c23243-d464-424c-9b6f-0b21124855bf service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:18.209079 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-48eca3b1-16fc-4cc5-b9b5-e13f76d750a4 req-63c23243-d464-424c-9b6f-0b21124855bf service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:18.220706 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-48eca3b1-16fc-4cc5-b9b5-e13f76d750a4 req-63c23243-d464-424c-9b6f-0b21124855bf service nova] Creating event network-changed:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:58:18.225824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-48eca3b1-16fc-4cc5-b9b5-e13f76d750a4 req-63c23243-d464-424c-9b6f-0b21124855bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032353 Jun 24 23:58:18.226796 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 538/1055] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:19.355186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-115921170"}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:19.355732 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:19.361908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:19.362357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:19.363123 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:19.363727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:19.495632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.network.security_group_api [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Adding security group b366b43b-35bc-4c52-8dd2-aaecaf9e7efa to port 64e4ac08-fbc4-48a2-953c-3f73cced876c Jun 24 23:58:19.852376 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9505578a-70e8-45fc-b2d9-16f4be3448b7 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action" status: 202 len: 0 microversion: 2.1 time: 0.501101 Jun 24 23:58:19.853299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 518/1056] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:58:19 2022] POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:58:19.863728 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:19.864738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:19.871268 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:19.872156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:19.873789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:19.874697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:20.050471 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:20.058968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-e2b31ad6-a0ea-4038-903d-045b6b6ead3d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1760 microversion: 2.1 time: 0.201098 Jun 24 23:58:20.059560 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 539/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:19 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1760 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:20.240015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-08f33165-d2ff-4c7b-8389-f929b5714664 req-9a50b01e-c5a6-4a06-9cf1-be95141f29c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:20.248193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-08f33165-d2ff-4c7b-8389-f929b5714664 req-9a50b01e-c5a6-4a06-9cf1-be95141f29c6 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:20.248666 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-08f33165-d2ff-4c7b-8389-f929b5714664 req-9a50b01e-c5a6-4a06-9cf1-be95141f29c6 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:20.260058 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-08f33165-d2ff-4c7b-8389-f929b5714664 req-9a50b01e-c5a6-4a06-9cf1-be95141f29c6 service nova] Creating event network-changed:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:58:20.265300 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-08f33165-d2ff-4c7b-8389-f929b5714664 req-9a50b01e-c5a6-4a06-9cf1-be95141f29c6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029210 Jun 24 23:58:20.266129 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 519/1058] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:58:42.631509 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:58:42.632448 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:42.634498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:42.635149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:42.641859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:42.642310 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:42.643074 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:42.644142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:42.718286 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-7fbe8d6a-c521-454a-9c7e-a97d1d1894e0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action" status: 202 len: 0 microversion: 2.1 time: 0.091045 Jun 24 23:58:42.722973 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 540/1059] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:58:42 2022] POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:58:42.729723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:42.730431 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:42.733007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:42.733629 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=70 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:58:42.741389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:42.741843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:42.742626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:42.743059 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:43.147839 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:43.155807 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-19200e2e-28f4-4588-b946-2f91a9f516f4 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1752 microversion: 2.1 time: 0.430670 Jun 24 23:58:43.156374 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 520/1060] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:42 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1752 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:44.175543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:44.176267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:44.182576 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:44.183029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:44.183800 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:44.184238 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:44.382370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:44.390789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4c6a6d35-5671-42af-a1a0-59e18271b43f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.219881 Jun 24 23:58:44.391352 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 541/1061] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:44 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:45.408277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:45.409144 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:45.415635 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:45.416085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:45.416894 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:45.417312 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:45.562966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:45.571386 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-239f1925-4a37-4a99-bea1-b9e5d4b469c0 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.167037 Jun 24 23:58:45.571948 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 521/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:45 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:46.588940 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:46.589544 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:46.595886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:46.596361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:46.597154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:46.597582 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:46.737500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:46.745227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b9055b50-0713-4f15-8583-1a45c758382b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.160161 Jun 24 23:58:46.745777 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 542/1063] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:46 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:47.763166 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:47.763738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:47.771345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:47.771794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:47.772562 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:47.773033 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:47.911882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:47.919730 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-cfb70edf-3d2c-417a-85b6-30f747b7ae0a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.160574 Jun 24 23:58:47.920293 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 522/1064] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:47 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:48.937233 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:48.937830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:48.944945 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:48.945396 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:48.946163 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:48.946594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:49.097326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:49.105280 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-87319422-797d-4f45-9e52-158d24487ae3 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.171939 Jun 24 23:58:49.105845 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 543/1065] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:48 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:50.123012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:50.123618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:50.130355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:50.130802 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:50.131552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:50.131982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:50.277105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:50.285459 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ac523a66-428b-49f1-ad4e-0f7bb224362d tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.166301 Jun 24 23:58:50.286017 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 523/1066] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:50 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:51.302903 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:51.303469 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:51.310095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:51.310662 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:51.311585 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:51.312025 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:51.454556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:51.462668 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a0dee2a9-23f9-438a-aa8f-a20a40649573 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.164209 Jun 24 23:58:51.463234 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 544/1067] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:51 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:52.479258 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:52.479904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:52.487101 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:52.488152 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:52.488951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:52.489391 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:52.629342 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:52.637221 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1448f061-d50b-4ec0-8efc-57811f259458 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.161921 Jun 24 23:58:52.637781 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 524/1068] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:52 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:53.654943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:53.655556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:53.662452 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:53.662891 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:53.663659 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:53.664095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:53.804299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:53.812235 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a5a0ceec-356f-4b87-9e93-ebb6cf83da78 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1757 microversion: 2.1 time: 0.161298 Jun 24 23:58:53.812830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 545/1069] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:53 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:54.829299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:58:54.829914 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:58:54.837039 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:54.837497 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:54.838266 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:58:54.838704 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:58:54.985444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:58:54.993977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-03cb6025-0438-4c08-a62f-7f3d5cfc754c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1760 microversion: 2.1 time: 0.168643 Jun 24 23:58:54.994632 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 525/1070] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:58:54 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:58:57.248951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 23:58:57.249581 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Fri Jun 24 23:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 23:59:27.355742 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-115921170"}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:59:27.356334 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:27.358486 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=12 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:27.359152 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:27.367017 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:27.367470 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:27.368243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:27.368717 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:27.506951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.network.security_group_api [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Removing security group b366b43b-35bc-4c52-8dd2-aaecaf9e7efa from port 64e4ac08-fbc4-48a2-953c-3f73cced876c Jun 24 23:59:27.844227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-1faa410d-2397-40df-bb19-9b52de796901 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action" status: 202 len: 0 microversion: 2.1 time: 0.492414 Jun 24 23:59:27.845352 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 546/1071] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jun 24 23:59:27 2022] POST /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:59:27.857663 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=12 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:27.859402 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=36 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:27.955776 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-f407445f-d07d-498c-8c5f-23c87c69f11a req-3f3566af-59aa-4574-a433-77501c47cdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:59:27.968462 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-f407445f-d07d-498c-8c5f-23c87c69f11a req-3f3566af-59aa-4574-a433-77501c47cdf7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:27.969179 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-f407445f-d07d-498c-8c5f-23c87c69f11a req-3f3566af-59aa-4574-a433-77501c47cdf7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:27.983633 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-f407445f-d07d-498c-8c5f-23c87c69f11a req-3f3566af-59aa-4574-a433-77501c47cdf7 service nova] Creating event network-changed:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:59:27.990357 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-f407445f-d07d-498c-8c5f-23c87c69f11a req-3f3566af-59aa-4574-a433-77501c47cdf7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137965 Jun 24 23:59:27.991348 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 526/1072] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:59:29.245154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:29.245680 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:29.251623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:29.252071 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:29.252854 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:29.253288 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:29.334032 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.objects.instance [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lazy-loading 'services' on Instance uuid 52e7b231-73b8-4dcd-8be1-875f857bd922 {{(pid=124092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 23:59:29.411646 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d0cafcff-a471-447a-80f2-11839e6e686a tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments/a255e9f9-2e19-4ca3-88c3-78fcac20718f" status: 202 len: 0 microversion: 2.1 time: 0.170418 Jun 24 23:59:29.412400 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 547/1073] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:59:29 2022] DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments/a255e9f9-2e19-4ca3-88c3-78fcac20718f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:59:29.421962 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:29.423719 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:29.431265 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:29.431723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:29.432534 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:29.433183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:29.464115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2daac1e7-ebfc-4e34-a0c3-7a33f2960d6f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Jun 24 23:59:29.464605 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 527/1074] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:59:29 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:59:30.006543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-be5bf132-833e-4083-89ac-6fe8be60d5c3 req-f5661f95-8c22-43ff-bbf8-992749a988fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:59:30.015886 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-be5bf132-833e-4083-89ac-6fe8be60d5c3 req-f5661f95-8c22-43ff-bbf8-992749a988fb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:30.016857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-be5bf132-833e-4083-89ac-6fe8be60d5c3 req-f5661f95-8c22-43ff-bbf8-992749a988fb service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:30.028115 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-be5bf132-833e-4083-89ac-6fe8be60d5c3 req-f5661f95-8c22-43ff-bbf8-992749a988fb service nova] Creating event network-changed:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:59:30.034748 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-be5bf132-833e-4083-89ac-6fe8be60d5c3 req-f5661f95-8c22-43ff-bbf8-992749a988fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033053 Jun 24 23:59:30.035390 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 548/1075] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 23:59:30.476911 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:30.477841 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:30.484271 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:30.484757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:30.485558 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:30.485989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:30.515349 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-a04a068d-d84b-4ace-8e8a-905c1bebb12c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043273 Jun 24 23:59:30.515904 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 528/1076] 10.222.0.47 () {58 vars in 1301 bytes} [Fri Jun 24 23:59:30 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 23:59:30.527320 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:30.528059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:30.535418 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:30.535875 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:30.536860 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:30.537308 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:30.615397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] HTTP exception thrown: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 is not attached to volume a255e9f9-2e19-4ca3-88c3-78fcac20718f Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Request method failure captured: Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments/a255e9f9-2e19-4ca3-88c3-78fcac20718f HTTP/1.1 Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk9vyRkzCYr4zR8yoJbk0ZeVIY-Cx8bpaJEQtzHrYGhI40LGnnQk9fdQQ-4MtirnjKH2YiJ0TY6REA-PbpfgGOczsvYoSIhl93otPdSaQKQl0PkOwfKg2zjfb3JQWHRcnans--M20cto5P4yZF-CnlsvMafHkjW-7PL75EPRFNLff3A Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: cc9f5775196a45df8de41ccff957b6ad Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:59:30.617763 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cc9f5775196a45df8de41ccff957b6ad"}]}] Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: cc9f5775196a45df8de41ccff957b6ad Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestMinimumBasicScenario-507031997-project Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: a23c541d3c33423597b22a233d899c36 Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestMinimumBasicScenario-507031997-project Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:59:30.619533 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 is not attached to volume a255e9f9-2e19-4ca3-88c3-78fcac20718f Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'server_id': '52e7b231-73b8-4dcd-8be1-875f857bd922', 'id': 'a255e9f9-2e19-4ca3-88c3-78fcac20718f'} Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a255e9f9-2e19-4ca3-88c3-78fcac20718f. Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:59:30.620341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 is not attached to volume a255e9f9-2e19-4ca3-88c3-78fcac20718f Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 is not attached to volume a255e9f9-2e19-4ca3-88c3-78fcac20718f Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:30.621664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Returning 404 to user: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 is not attached to volume a255e9f9-2e19-4ca3-88c3-78fcac20718f {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:59:30.622637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-39638f3d-d670-4dc8-8e6b-fb322f85052f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments/a255e9f9-2e19-4ca3-88c3-78fcac20718f" status: 404 len: 154 microversion: 2.1 time: 0.096300 Jun 24 23:59:30.622637 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 549/1077] 10.222.0.47 () {58 vars in 1415 bytes} [Fri Jun 24 23:59:30 2022] DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922/os-volume_attachments/a255e9f9-2e19-4ca3-88c3-78fcac20718f => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:59:31.753295 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:31.754623 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:31.761908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:31.762355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:31.763121 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:31.763555 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:31.788117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 23:59:31.859015 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-70b9936a-793f-4f9a-a36b-fc71a4c4323c tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 204 len: 0 microversion: 2.1 time: 0.109292 Jun 24 23:59:31.859621 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 529/1078] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Jun 24 23:59:31 2022] DELETE /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 23:59:31.868081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:31.868784 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:31.875155 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:31.875597 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:31.876353 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:31.876824 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:32.011906 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:59:32.019767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0a2bfa7b-9b15-4ac7-a88b-ce0b2425cf4b tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1555 microversion: 2.1 time: 0.155257 Jun 24 23:59:32.020426 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 550/1079] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:59:31 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:59:33.036676 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:33.037379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:33.043796 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:33.044234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:33.045019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:33.045450 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:33.174338 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:59:33.182507 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-3a70ed00-c158-4ce9-88d5-521ca25063e6 tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1555 microversion: 2.1 time: 0.150175 Jun 24 23:59:33.183057 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 530/1080] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:59:33 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:59:34.200127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:34.204331 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:34.211999 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:34.212444 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:34.213243 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:34.213682 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:34.291076 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23c541d3c33423597b22a233d899c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f5775196a45df8de41ccff957b6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 23:59:34.299100 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-56217d72-b00f-4d05-b7d0-b647b421c2ca tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 200 len: 1513 microversion: 2.1 time: 0.103043 Jun 24 23:59:34.299783 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 551/1081] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:59:34 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 23:59:34.312787 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-c0050f46-b931-4c96-a4be-ff2760d8ea3a req-ab7b3a11-64be-47b1-96f8-1d6c409ec09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e7b231-73b8-4dcd-8be1-875f857bd922", "name": "network-vif-deleted", "tag": "64e4ac08-fbc4-48a2-953c-3f73cced876c"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:59:34.321245 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-c0050f46-b931-4c96-a4be-ff2760d8ea3a req-ab7b3a11-64be-47b1-96f8-1d6c409ec09f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:34.321693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-c0050f46-b931-4c96-a4be-ff2760d8ea3a req-ab7b3a11-64be-47b1-96f8-1d6c409ec09f service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:34.333410 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-c0050f46-b931-4c96-a4be-ff2760d8ea3a req-ab7b3a11-64be-47b1-96f8-1d6c409ec09f service nova] Creating event network-vif-deleted:64e4ac08-fbc4-48a2-953c-3f73cced876c for instance 52e7b231-73b8-4dcd-8be1-875f857bd922 on hv-cinder-84762 Jun 24 23:59:34.339236 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-c0050f46-b931-4c96-a4be-ff2760d8ea3a req-ab7b3a11-64be-47b1-96f8-1d6c409ec09f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097709 Jun 24 23:59:34.340233 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 531/1082] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jun 24 23:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 23:59:35.317127 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:35.317672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] [instance: 52e7b231-73b8-4dcd-8be1-875f857bd922] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 23:59:35.324181 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:35.324732 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:35.325506 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 23:59:35.325947 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 23:59:35.339623 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] HTTP exception thrown: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Request method failure captured: Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 HTTP/1.1 Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk9vyRkzCYr4zR8yoJbk0ZeVIY-Cx8bpaJEQtzHrYGhI40LGnnQk9fdQQ-4MtirnjKH2YiJ0TY6REA-PbpfgGOczsvYoSIhl93otPdSaQKQl0PkOwfKg2zjfb3JQWHRcnans--M20cto5P4yZF-CnlsvMafHkjW-7PL75EPRFNLff3A Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: cc9f5775196a45df8de41ccff957b6ad Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 24 23:59:35.341161 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cc9f5775196a45df8de41ccff957b6ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cc9f5775196a45df8de41ccff957b6ad"}]}] Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: cc9f5775196a45df8de41ccff957b6ad Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestMinimumBasicScenario-507031997 Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestMinimumBasicScenario-507031997-project Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: a23c541d3c33423597b22a233d899c36 Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestMinimumBasicScenario-507031997-project Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. Jun 24 23:59:35.342874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '52e7b231-73b8-4dcd-8be1-875f857bd922'} Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 23:59:35.343827 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. Jun 24 23:59:35.345474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 24 23:59:35.347157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Returning 404 to user: Instance 52e7b231-73b8-4dcd-8be1-875f857bd922 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 23:59:35.347157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c7d05edb-104b-46e8-b962-ccfdbbb3b04f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922" status: 404 len: 111 microversion: 2.1 time: 0.029615 Jun 24 23:59:35.347157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 552/1083] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Jun 24 23:59:35 2022] GET /compute/v2.1/servers/52e7b231-73b8-4dcd-8be1-875f857bd922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 23:59:35.352928 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8a5ab2fb-74b5-449e-9d35-d0255a96b69f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] Calling method '.version_select at 0x7f7a55cebdc0>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 23:59:35.372934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8a5ab2fb-74b5-449e-9d35-d0255a96b69f tempest-TestMinimumBasicScenario-507031997 tempest-TestMinimumBasicScenario-507031997-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1986054684" status: 202 len: 0 microversion: 2.1 time: 0.024119 Jun 24 23:59:35.373489 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 532/1084] 10.222.0.47 () {58 vars in 1271 bytes} [Fri Jun 24 23:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1986054684 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 23:59:53.195919 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=14 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:53.196661 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:59:53.368309 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-4a20c238-9483-4d88-a291-2086e09da3a5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Action: 'create', calling method: .version_select at 0x7f7a55e1ea60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-740810056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXoTWlTLhFZRBkCCYIygBgS/UOVR2Tj6Lv+3DOe7qs1wjfbUBLhHtnNGmnl0LULZ9o6ql16yWjqBXwLiFcnH895O2WGLrOeDhQMMKgqwTizYV4Dj8CCXSlpW7DIwr7PA=="}} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 23:59:53.383968 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-4a20c238-9483-4d88-a291-2086e09da3a5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 23:59:53.387793 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.quota [None req-4a20c238-9483-4d88-a291-2086e09da3a5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for user bd94685199f44a218dd96397b02cdc39 and project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'key_pairs'} {{(pid=124092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 23:59:53.412012 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-4a20c238-9483-4d88-a291-2086e09da3a5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.220920 Jun 24 23:59:53.412880 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 553/1085] 10.222.0.47 () {60 vars in 1158 bytes} [Fri Jun 24 23:59:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:00:09.845880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:09.846623 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:09.851674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1243481662", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-740810056", "security_groups": [{"name": "tempest-secgroup-smoke-24680619"}], "block_device_mapping_v2": [{"uuid": "819e7699-c511-47ce-8fb0-7208e7e1f49b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0b56275-34ca-42ce-9ac1-57cba9c7f745"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:00:09.969292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] validate_networks() for [('e0b56275-34ca-42ce-9ac1-57cba9c7f745', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 00:00:10.436117 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 00:00:10.436575 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 00:00:10.437078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 00:00:10.437493 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 00:00:10.437915 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 00:00:10.447066 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:10.447518 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:10.448324 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:10.448828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:10.465108 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 00:00:10.469009 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for user bd94685199f44a218dd96397b02cdc39 and project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 00:00:10.525301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 00:00:10.527464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='819e7699-c511-47ce-8fb0-7208e7e1f49b',volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 00:00:10.650659 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [7cb7e139-6b9d-43d6-98af-b1413b164147] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 00:00:11.658387 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [7cb7e139-6b9d-43d6-98af-b1413b164147] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46496. Jun 25 00:00:11.662684 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ac660b4a-d1b4-4a9b-9c03-e54edc8f99b8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.818418 Jun 25 00:00:11.663331 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 533/1086] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jun 25 00:00:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 00:00:11.670738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:11.671874 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:11.676433 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d1e154ce-4186-4369-9e1b-040ebaece172 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:11.677080 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d1e154ce-4186-4369-9e1b-040ebaece172 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:11.735029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d1e154ce-4186-4369-9e1b-040ebaece172 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:11.741692 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d1e154ce-4186-4369-9e1b-040ebaece172 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1094 microversion: 2.1 time: 0.072227 Jun 25 00:00:11.742281 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 554/1087] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:11 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:12.759846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e7989fe7-e882-4650-8079-df35ea11a565 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:12.760556 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e7989fe7-e882-4650-8079-df35ea11a565 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:12.816641 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e7989fe7-e882-4650-8079-df35ea11a565 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:12.824503 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e7989fe7-e882-4650-8079-df35ea11a565 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1094 microversion: 2.1 time: 0.069547 Jun 25 00:00:12.825105 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 534/1088] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:12 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:13.841621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5b61ccee-931a-45dd-98a8-76c96ca7c242 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:13.842239 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5b61ccee-931a-45dd-98a8-76c96ca7c242 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:13.895674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5b61ccee-931a-45dd-98a8-76c96ca7c242 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:13.902928 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5b61ccee-931a-45dd-98a8-76c96ca7c242 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1094 microversion: 2.1 time: 0.065159 Jun 25 00:00:13.904052 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 555/1089] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:13 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:14.919855 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-87142be1-c126-4fe0-a170-98863dbfc824 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:14.920556 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-87142be1-c126-4fe0-a170-98863dbfc824 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:14.978812 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-87142be1-c126-4fe0-a170-98863dbfc824 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:14.985945 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-87142be1-c126-4fe0-a170-98863dbfc824 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1094 microversion: 2.1 time: 0.069921 Jun 25 00:00:14.986524 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 535/1090] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:14 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:16.005456 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:16.006579 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:16.015109 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:16.015559 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:16.016320 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:16.016786 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:16.077326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:16.085532 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a919e726-342e-4e11-948b-98b03c6e9ad7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1144 microversion: 2.1 time: 0.083924 Jun 25 00:00:16.086086 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 556/1091] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:16 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:17.109305 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:17.110358 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:17.122894 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:17.124024 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:17.125432 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:17.126226 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:17.248043 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:17.257723 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-58d26672-b15c-41af-ae0f-ceac9be2e09f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1210 microversion: 2.1 time: 0.155996 Jun 25 00:00:17.258287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 536/1092] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:17 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 00:00:18.228558 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-3e367590-3508-489e-a121-62b6070f318f req-10b9cecc-0860-4282-a53e-d7a631f6fe66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e76b40-abc1-4a87-8af4-518dfea01db4", "tag": "ed5243d5-100d-49fd-aeed-3bb0533e6efd"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:00:18.237697 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-3e367590-3508-489e-a121-62b6070f318f req-10b9cecc-0860-4282-a53e-d7a631f6fe66 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:18.238117 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-3e367590-3508-489e-a121-62b6070f318f req-10b9cecc-0860-4282-a53e-d7a631f6fe66 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:18.252094 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-3e367590-3508-489e-a121-62b6070f318f req-10b9cecc-0860-4282-a53e-d7a631f6fe66 service nova] Creating event network-changed:ed5243d5-100d-49fd-aeed-3bb0533e6efd for instance 54e76b40-abc1-4a87-8af4-518dfea01db4 on hv-cinder-84762 Jun 25 00:00:18.256938 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-3e367590-3508-489e-a121-62b6070f318f req-10b9cecc-0860-4282-a53e-d7a631f6fe66 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032836 Jun 25 00:00:18.257535 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 557/1093] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:00:18.275260 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:18.275873 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:18.282848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:18.283783 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:18.284699 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:18.285205 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:18.504552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:18.512705 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-2130f378-492c-44b1-a1ae-98058a7c9662 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.241810 Jun 25 00:00:18.513269 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 537/1094] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:18 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:19.531672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:19.532276 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:19.538382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:19.539330 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:19.540082 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:19.540512 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:19.675481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:19.683629 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-fc1c8cc6-e982-469b-b14f-040b06b8d388 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.156695 Jun 25 00:00:19.684185 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 558/1095] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:19 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:20.700362 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:20.701021 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:20.703299 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:20.708746 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:20.709201 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:20.709961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:20.710914 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:20.841542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:20.848872 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-fdda1ab4-c2a8-47dd-9bc7-eaecb1dda4e5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.152375 Jun 25 00:00:20.849428 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 538/1096] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:20 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:21.866146 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:21.866909 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:21.873767 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:21.874217 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:21.874980 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:21.875420 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:22.007078 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:22.014950 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-ee023505-9318-4425-b88c-a106736d10ad tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.152714 Jun 25 00:00:22.015497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 559/1097] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:21 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:23.032407 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:23.033068 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:23.040215 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:23.040696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:23.041468 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:23.041922 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:23.176345 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:23.184677 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-695e433a-72f7-45d7-85b7-43738dd3ab94 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.156127 Jun 25 00:00:23.185229 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 539/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:23 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:24.201463 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:24.202018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:24.203930 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:24.209374 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:24.209814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:24.210565 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:24.210998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:24.340267 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:24.347671 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-82a2a99e-cd59-46cf-86f1-5c0db55d449c tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.150227 Jun 25 00:00:24.348227 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 560/1099] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:24 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:25.365505 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:25.366115 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:25.368925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=10 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:00:25.374403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:25.374846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:25.375602 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:25.376032 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:25.504174 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:25.511762 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-174c9e31-0ce0-4319-ab6d-f2c5e28346f1 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.150105 Jun 25 00:00:25.512326 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 540/1100] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:25 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:26.529541 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:26.530180 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:26.536483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:26.536958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:26.537712 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:26.538140 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:26.680975 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:26.688328 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9e28f833-a4d1-4b9e-9ec8-ef10827181c8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.162732 Jun 25 00:00:26.688917 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 561/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:26 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:27.705423 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:27.706042 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:27.712626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:27.713086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:27.713851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:27.714292 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:27.845589 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:27.853660 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9c454795-4407-4d33-bad7-1e4fe5429eb6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.152177 Jun 25 00:00:27.854220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 541/1102] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:27 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:28.168789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-dffa9177-f239-406f-88ee-85083a8ba259 req-c1f7b651-fdc3-4492-aaf3-5930cfd30497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e76b40-abc1-4a87-8af4-518dfea01db4", "name": "network-vif-plugged", "status": "completed", "tag": "ed5243d5-100d-49fd-aeed-3bb0533e6efd"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:00:28.177250 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-dffa9177-f239-406f-88ee-85083a8ba259 req-c1f7b651-fdc3-4492-aaf3-5930cfd30497 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:28.177694 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-dffa9177-f239-406f-88ee-85083a8ba259 req-c1f7b651-fdc3-4492-aaf3-5930cfd30497 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:28.188453 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-dffa9177-f239-406f-88ee-85083a8ba259 req-c1f7b651-fdc3-4492-aaf3-5930cfd30497 service nova] Creating event network-vif-plugged:ed5243d5-100d-49fd-aeed-3bb0533e6efd for instance 54e76b40-abc1-4a87-8af4-518dfea01db4 on hv-cinder-84762 Jun 25 00:00:28.193615 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-dffa9177-f239-406f-88ee-85083a8ba259 req-c1f7b651-fdc3-4492-aaf3-5930cfd30497 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089882 Jun 25 00:00:28.194182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 562/1103] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 00:00:28.871046 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:28.871650 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:28.878102 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:28.878544 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:28.879296 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:28.879726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:29.011286 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:29.018958 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-45e655f4-cd42-4520-8c30-22f4e40f81e6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1264 microversion: 2.1 time: 0.152388 Jun 25 00:00:29.019515 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 542/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:28 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:30.036125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:30.036862 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:30.043491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:30.043934 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:30.044725 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:30.045154 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:30.179841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:30.187190 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-765c059e-c04f-44b2-9311-568c299242c6 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1449 microversion: 2.1 time: 0.155257 Jun 25 00:00:30.187745 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 563/1105] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:30 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:30.203618 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:00:30.204225 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:00:30.211211 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:30.211760 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:30.212523 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:30.212980 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:30.349892 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:00:30.361194 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-78235417-a4cd-401a-acb7-92fd1f100610 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1449 microversion: 2.1 time: 0.161324 Jun 25 00:00:30.361754 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 543/1106] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:00:30 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:00:32.233222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-51bfe20a-c537-42c3-a7c4-b96beff6a68b req-a605a446-3a83-4295-9080-6fccaf06b1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e76b40-abc1-4a87-8af4-518dfea01db4", "tag": "ed5243d5-100d-49fd-aeed-3bb0533e6efd"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:00:32.242740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-51bfe20a-c537-42c3-a7c4-b96beff6a68b req-a605a446-3a83-4295-9080-6fccaf06b1cc service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:00:32.243176 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-51bfe20a-c537-42c3-a7c4-b96beff6a68b req-a605a446-3a83-4295-9080-6fccaf06b1cc service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:00:32.254708 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-51bfe20a-c537-42c3-a7c4-b96beff6a68b req-a605a446-3a83-4295-9080-6fccaf06b1cc service nova] Creating event network-changed:ed5243d5-100d-49fd-aeed-3bb0533e6efd for instance 54e76b40-abc1-4a87-8af4-518dfea01db4 on hv-cinder-84762 Jun 25 00:00:32.260338 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-51bfe20a-c537-42c3-a7c4-b96beff6a68b req-a605a446-3a83-4295-9080-6fccaf06b1cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030973 Jun 25 00:00:32.260984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 564/1107] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:00:37.227873 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:00:37.228627 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:00:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:02:17.257671 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:02:17.258190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Sat Jun 25 00:02:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:02:28.472190 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:28.472986 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=50 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:28.477478 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:28.477980 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:28.486189 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:28.486637 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:28.487412 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:28.487851 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:28.513514 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 00:02:28.572757 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [45eee79d-e9b1-41ac-bbf9-3aa295b25827] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 00:02:29.584741 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [45eee79d-e9b1-41ac-bbf9-3aa295b25827] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46604. Jun 25 00:02:29.604498 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8d6cead8-dad6-469d-9ccc-552f05d976cd tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 204 len: 0 microversion: 2.1 time: 1.134050 Jun 25 00:02:29.605150 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 544/1108] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jun 25 00:02:28 2022] DELETE /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 00:02:29.612305 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef7a8b77-45a8-4f16-b94e-9474a648fb3f] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 25 00:02:29.614096 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=26 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:29.614096 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=42 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:29.618252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:29.618951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:29.626391 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:29.626847 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:29.627594 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:29.628026 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:29.763203 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:29.770998 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-19ae1e8e-154f-437e-96b6-efd87710960d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1574 microversion: 2.1 time: 0.160900 Jun 25 00:02:29.771645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 565/1109] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:29 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:30.795160 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:30.795854 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:30.802196 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:30.802640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:30.803389 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:30.803824 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:30.934154 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:30.941874 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0d7c1e2e-a5f2-4a02-8e7a-a47b4494e301 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1574 microversion: 2.1 time: 0.151699 Jun 25 00:02:30.942438 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 545/1110] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:30 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:31.958789 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:31.959410 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:31.971500 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef7a8b77-45a8-4f16-b94e-9474a648fb3f] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46616. Jun 25 00:02:31.974253 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:31.974715 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:31.975491 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:31.975937 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:32.041864 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:32.049484 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-618ca5cf-8402-498b-8ec1-aa0fb8470e6d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 200 len: 1508 microversion: 2.1 time: 0.094477 Jun 25 00:02:32.049974 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 566/1111] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:31 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 1508 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:32.244220 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-3c8e026c-2206-4023-98c9-91d1cf986e7e req-c635ad7e-3541-47a6-a345-43970181de04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e76b40-abc1-4a87-8af4-518dfea01db4", "name": "network-vif-deleted", "tag": "ed5243d5-100d-49fd-aeed-3bb0533e6efd"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:02:32.252951 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-3c8e026c-2206-4023-98c9-91d1cf986e7e req-c635ad7e-3541-47a6-a345-43970181de04 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:32.253388 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-3c8e026c-2206-4023-98c9-91d1cf986e7e req-c635ad7e-3541-47a6-a345-43970181de04 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:32.266578 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-3c8e026c-2206-4023-98c9-91d1cf986e7e req-c635ad7e-3541-47a6-a345-43970181de04 service nova] Creating event network-vif-deleted:ed5243d5-100d-49fd-aeed-3bb0533e6efd for instance 54e76b40-abc1-4a87-8af4-518dfea01db4 on hv-cinder-84762 Jun 25 00:02:32.272149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-3c8e026c-2206-4023-98c9-91d1cf986e7e req-c635ad7e-3541-47a6-a345-43970181de04 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Jun 25 00:02:32.272893 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 546/1112] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:02:33.067047 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:33.067775 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:33.075112 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:33.075563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:33.076341 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:33.076810 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:33.091461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] HTTP exception thrown: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Request method failure captured: Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 HTTP/1.1 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk_z2sFqJu04pXwhxozQTuMEScjk4Lj2qOGMDogtwmlzvYEEtsVR8Q2XuZYkf-860G_YdHqSTyp4631mVUCTkLvLcGJjr16JO_EuYmpxcNVyPgGNu9jTyvGbGs43Rx012bukAR7OFn2wAw_oW6HhsWzLFdl6WyJiSYwl77qrJQCnaqU Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 25 00:02:33.093189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}] Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: bd94685199f44a218dd96397b02cdc39 Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:02:33.094830 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '54e76b40-abc1-4a87-8af4-518dfea01db4'} Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 00:02:33.095691 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:02:33.097095 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:02:33.098304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Returning 404 to user: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 00:02:33.098304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-f37ac17b-27dc-4bd5-9263-592f7aa6031d tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 404 len: 111 microversion: 2.1 time: 0.031647 Jun 25 00:02:33.098304 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 567/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:33 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 00:02:33.144228 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-19478109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-740810056", "security_groups": [{"name": "tempest-secgroup-smoke-24680619"}], "block_device_mapping_v2": [{"uuid": "819e7699-c511-47ce-8fb0-7208e7e1f49b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0b56275-34ca-42ce-9ac1-57cba9c7f745"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:02:33.286341 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] validate_networks() for [('e0b56275-34ca-42ce-9ac1-57cba9c7f745', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 00:02:33.676429 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 00:02:33.676899 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 00:02:33.677382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 00:02:33.677832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 00:02:33.678251 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 00:02:33.687520 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:33.687972 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:33.688819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:33.689267 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:33.706395 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 00:02:33.710364 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for user bd94685199f44a218dd96397b02cdc39 and project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 00:02:33.766635 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 00:02:33.768818 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='819e7699-c511-47ce-8fb0-7208e7e1f49b',volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 00:02:33.904453 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d2ef95c1-6599-4fbc-b7e9-2abfd1a45b58 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.764508 Jun 25 00:02:33.905363 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 547/1114] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jun 25 00:02:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 00:02:33.915287 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bb256f78-01cc-49e7-aaed-2eef93a2697b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:33.915922 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bb256f78-01cc-49e7-aaed-2eef93a2697b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:33.969718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-bb256f78-01cc-49e7-aaed-2eef93a2697b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:33.976941 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bb256f78-01cc-49e7-aaed-2eef93a2697b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1092 microversion: 2.1 time: 0.065533 Jun 25 00:02:33.977490 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 568/1115] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:33 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 00:02:34.993111 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:34.993722 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:35.000963 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:35.001467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:35.002234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:35.002674 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:35.071559 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:35.079832 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f922548c-5e8b-420f-812a-3a3574e1890f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1208 microversion: 2.1 time: 0.090550 Jun 25 00:02:35.080600 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 548/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:34 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:36.097021 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:36.097645 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:36.104928 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:36.105918 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:36.106683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:36.107130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:36.246431 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:36.254208 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2252806a-db8c-4949-8624-1028ae1085ed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.161191 Jun 25 00:02:36.254756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 569/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:36 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:36.538846 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-e11343b5-712c-4453-bbe1-169d33bffcf8 req-9b57790d-706d-4e41-936a-f532d135ac15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d7008c-aac5-429c-95ed-c0d657b171b0", "tag": "ed699f34-9911-4658-ba30-242a66cb008e"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:02:36.553844 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e11343b5-712c-4453-bbe1-169d33bffcf8 req-9b57790d-706d-4e41-936a-f532d135ac15 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:36.555134 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-e11343b5-712c-4453-bbe1-169d33bffcf8 req-9b57790d-706d-4e41-936a-f532d135ac15 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:36.571019 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-e11343b5-712c-4453-bbe1-169d33bffcf8 req-9b57790d-706d-4e41-936a-f532d135ac15 service nova] Creating event network-changed:ed699f34-9911-4658-ba30-242a66cb008e for instance 02d7008c-aac5-429c-95ed-c0d657b171b0 on hv-cinder-84762 Jun 25 00:02:36.578259 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-e11343b5-712c-4453-bbe1-169d33bffcf8 req-9b57790d-706d-4e41-936a-f532d135ac15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043985 Jun 25 00:02:36.578850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 549/1118] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:02:37.273772 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:37.274382 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:37.281125 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:37.281571 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:37.282321 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:37.282756 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:37.411885 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:37.420235 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0d6afff3-8ad6-4101-9df4-517715bc3cec tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.151014 Jun 25 00:02:37.420817 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 570/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:37 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:38.438175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:38.438866 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:38.445000 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:38.445444 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:38.446193 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:38.446626 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:38.577880 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:38.585382 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1fb09292-eb10-40fe-bf68-e7ab62c48f31 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.152294 Jun 25 00:02:38.585932 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 550/1120] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:38 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:39.603219 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:39.603871 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:39.610893 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:39.611344 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:39.612103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:39.612541 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:39.741958 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:39.750411 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b68c460c-b9bc-446d-aa9c-0286233aee4e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.151025 Jun 25 00:02:39.750956 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 571/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:39 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:40.767217 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:40.767828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:40.775467 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:40.775916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:40.776725 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:40.777693 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:40.910997 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:40.919614 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-07120274-b749-4928-84c7-595298951df9 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.156394 Jun 25 00:02:40.920183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 551/1122] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:40 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:41.936710 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:41.937349 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:41.943760 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:41.944200 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:41.944983 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:41.945412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:42.078231 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:42.085674 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9f1d122f-c668-4efb-9055-118397be6600 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.153284 Jun 25 00:02:42.086226 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 572/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:41 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:43.102696 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:43.103318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:43.110850 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:43.111301 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:43.112086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:43.112525 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:43.257844 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:43.266536 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-7b688e33-5e96-4d26-951e-1b4c28744fb8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.167789 Jun 25 00:02:43.267087 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 552/1124] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:43 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:44.283778 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:44.284449 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:44.286740 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=2 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:44.292230 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:44.292734 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:44.293514 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:44.294884 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:44.424102 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:44.431549 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-3147b478-6359-4bfc-b854-edfe6e865eb7 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.151620 Jun 25 00:02:44.432110 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 573/1125] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:44 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:45.447234 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:45.447779 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:45.449773 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:45.450735 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=6 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:02:45.458630 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:45.459084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:45.459853 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:45.460324 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:45.594567 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:45.602163 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-67fdffe4-e1c5-4807-b37a-729eb4c00d39 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.158859 Jun 25 00:02:45.602745 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 553/1126] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:45 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:46.619654 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:46.620412 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:46.627920 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:46.628360 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:46.629162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:46.629596 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:46.740876 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-02943e8f-40bf-4af6-8ac2-4bd28488b0e7 req-79c026bd-929f-4f3a-bb36-fead7566b017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d7008c-aac5-429c-95ed-c0d657b171b0", "name": "network-vif-plugged", "status": "completed", "tag": "ed699f34-9911-4658-ba30-242a66cb008e"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:02:46.753213 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-02943e8f-40bf-4af6-8ac2-4bd28488b0e7 req-79c026bd-929f-4f3a-bb36-fead7566b017 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:46.753848 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-02943e8f-40bf-4af6-8ac2-4bd28488b0e7 req-79c026bd-929f-4f3a-bb36-fead7566b017 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:46.771083 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-02943e8f-40bf-4af6-8ac2-4bd28488b0e7 req-79c026bd-929f-4f3a-bb36-fead7566b017 service nova] Creating event network-vif-plugged:ed699f34-9911-4658-ba30-242a66cb008e for instance 02d7008c-aac5-429c-95ed-c0d657b171b0 on hv-cinder-84762 Jun 25 00:02:46.780906 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-02943e8f-40bf-4af6-8ac2-4bd28488b0e7 req-79c026bd-929f-4f3a-bb36-fead7566b017 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043177 Jun 25 00:02:46.781964 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 554/1127] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 00:02:46.799162 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:46.813105 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-2791483d-3cd5-4cec-89f1-fa98eba9d69f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.197443 Jun 25 00:02:46.814014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 574/1128] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:46 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:47.830984 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:47.831683 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:47.837843 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:47.838287 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:47.839041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:47.839473 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:47.974650 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:47.982479 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0794fd30-e742-40f4-baa0-ea1f0ecb1b44 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1262 microversion: 2.1 time: 0.156253 Jun 25 00:02:47.983028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 555/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:47 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 00:02:48.999724 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:49.000389 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:49.006814 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:49.007259 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:49.008006 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:49.008434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:49.136711 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:49.145591 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-75de75d3-ea4b-43a6-a66d-37f63d1bb386 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1447 microversion: 2.1 time: 0.149915 Jun 25 00:02:49.146402 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 575/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:48 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:49.162334 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:02:49.162955 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:02:49.170132 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:49.170585 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:49.171359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:49.171800 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:49.304141 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:02:49.311895 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-1cd8472a-c620-4964-a96a-096e5bee24d2 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1447 microversion: 2.1 time: 0.153385 Jun 25 00:02:49.312463 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 556/1131] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:02:49 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:02:51.142142 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-14a1d2ff-fe3d-410c-af9f-30acc0e43a0a req-c0c5ad20-5500-4122-90e2-0b03c48bb4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d7008c-aac5-429c-95ed-c0d657b171b0", "tag": "ed699f34-9911-4658-ba30-242a66cb008e"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:02:51.150855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-14a1d2ff-fe3d-410c-af9f-30acc0e43a0a req-c0c5ad20-5500-4122-90e2-0b03c48bb4e7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:02:51.151293 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-14a1d2ff-fe3d-410c-af9f-30acc0e43a0a req-c0c5ad20-5500-4122-90e2-0b03c48bb4e7 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:02:51.162914 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-14a1d2ff-fe3d-410c-af9f-30acc0e43a0a req-c0c5ad20-5500-4122-90e2-0b03c48bb4e7 service nova] Creating event network-changed:ed699f34-9911-4658-ba30-242a66cb008e for instance 02d7008c-aac5-429c-95ed-c0d657b171b0 on hv-cinder-84762 Jun 25 00:02:51.168222 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-14a1d2ff-fe3d-410c-af9f-30acc0e43a0a req-c0c5ad20-5500-4122-90e2-0b03c48bb4e7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029832 Jun 25 00:02:51.170055 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 576/1132] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:03:57.235818 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:03:57.236502 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:03:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:04:25.184994 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:25.185765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:25.191025 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-889172520", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-740810056", "security_groups": [{"name": "tempest-secgroup-smoke-24680619"}], "block_device_mapping_v2": [{"uuid": "39545e3e-1069-452d-9440-2d932603f747", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0b56275-34ca-42ce-9ac1-57cba9c7f745"}]}} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:04:25.448169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.network.neutron [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] validate_networks() for [('e0b56275-34ca-42ce-9ac1-57cba9c7f745', None, None, None, None, None)] {{(pid=124093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 00:04:25.810012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 00:04:25.810441 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image limits 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 00:04:25.810913 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Flavor pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 00:04:25.811323 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Image pref 0:0:0 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 00:04:25.811734 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.virt.hardware [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 00:04:25.820977 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:25.821425 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:25.822219 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:25.822657 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:25.840041 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 00:04:25.844156 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.quota [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Getting quotas for user bd94685199f44a218dd96397b02cdc39 and project f10b8a1bc1654ae4ac5c08c23ca9e399. Resources: {'ram', 'cores', 'instances'} {{(pid=124093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 00:04:25.900931 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Going to run 1 instances... {{(pid=124093) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 00:04:25.903028 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39545e3e-1069-452d-9440-2d932603f747',volume_size=None,volume_type=None)] {{(pid=124093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 00:04:26.038885 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e490bb9c-a747-47ac-9e7e-6344ddaa2996 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.855725 Jun 25 00:04:26.039526 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 557/1133] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jun 25 00:04:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 00:04:26.048130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=26 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:26.048879 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=58 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:26.052885 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-546afb51-d875-48ae-9794-b7a8edfbd161 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:26.053576 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-546afb51-d875-48ae-9794-b7a8edfbd161 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:26.168221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-546afb51-d875-48ae-9794-b7a8edfbd161 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:26.175366 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-546afb51-d875-48ae-9794-b7a8edfbd161 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1093 microversion: 2.1 time: 0.129674 Jun 25 00:04:26.175907 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 577/1134] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:26 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1093 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:27.193789 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e86ed41f-acff-49cc-9de5-0294ca082a3a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:27.194403 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-e86ed41f-acff-49cc-9de5-0294ca082a3a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:27.248882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-e86ed41f-acff-49cc-9de5-0294ca082a3a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:27.256736 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e86ed41f-acff-49cc-9de5-0294ca082a3a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1093 microversion: 2.1 time: 0.066873 Jun 25 00:04:27.257277 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 558/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:27 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:28.273770 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-0c54e538-6f71-41c5-8125-55d834d95344 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:28.274386 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-0c54e538-6f71-41c5-8125-55d834d95344 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:28.326846 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-0c54e538-6f71-41c5-8125-55d834d95344 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:28.334599 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-0c54e538-6f71-41c5-8125-55d834d95344 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1093 microversion: 2.1 time: 0.064923 Jun 25 00:04:28.335148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 578/1136] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:28 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:29.352327 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-13d8c178-f9c3-4b5d-a33a-52407fdc7fed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:29.353006 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-13d8c178-f9c3-4b5d-a33a-52407fdc7fed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:29.408484 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-13d8c178-f9c3-4b5d-a33a-52407fdc7fed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:29.415351 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-13d8c178-f9c3-4b5d-a33a-52407fdc7fed tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1093 microversion: 2.1 time: 0.067064 Jun 25 00:04:29.420842 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 559/1137] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:29 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:30.432863 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:30.433483 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:30.440171 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:30.440658 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:30.441429 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:30.441870 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:30.510685 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:30.519099 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-00c15ca5-c5b1-4942-a7ea-85acf7e0c756 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1143 microversion: 2.1 time: 0.090098 Jun 25 00:04:30.519660 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 579/1138] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:30 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:31.535726 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:31.536961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:31.545274 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:31.545925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:31.546711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:31.547149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:31.627461 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:31.635742 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-4fb6711d-13fe-4f62-8342-fb6b45e79a71 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1209 microversion: 2.1 time: 0.103981 Jun 25 00:04:31.636313 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 560/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:31 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:32.500058 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-bc81a518-3121-4070-99db-b972b00b0681 req-3810b279-fdd0-4e5d-94b6-9c63941f36a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f736e33c-085c-40bf-ba13-828a757ef334", "tag": "2d011638-71b2-4f9b-92c8-9a76a475039c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:04:32.511701 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bc81a518-3121-4070-99db-b972b00b0681 req-3810b279-fdd0-4e5d-94b6-9c63941f36a5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:32.512160 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bc81a518-3121-4070-99db-b972b00b0681 req-3810b279-fdd0-4e5d-94b6-9c63941f36a5 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:32.532130 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-bc81a518-3121-4070-99db-b972b00b0681 req-3810b279-fdd0-4e5d-94b6-9c63941f36a5 service nova] Creating event network-changed:2d011638-71b2-4f9b-92c8-9a76a475039c for instance f736e33c-085c-40bf-ba13-828a757ef334 on hv-cinder-84762 Jun 25 00:04:32.537479 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-bc81a518-3121-4070-99db-b972b00b0681 req-3810b279-fdd0-4e5d-94b6-9c63941f36a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041508 Jun 25 00:04:32.538348 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 580/1140] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:04:32.654003 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:32.654622 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:32.662552 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:32.663516 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:32.664456 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:32.665023 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:32.874536 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:32.882080 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-b9c828e2-d2da-49f9-b3eb-b562574e5649 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.232236 Jun 25 00:04:32.882643 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 561/1141] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:32 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:33.900421 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:33.901043 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:33.907213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:33.908218 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:33.909014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:33.909445 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:34.053946 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:34.062002 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-5b373ac2-8ce2-454e-b380-e63eb7756859 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.166492 Jun 25 00:04:34.062569 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 581/1142] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:33 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:35.078640 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:35.079243 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:35.085707 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:35.086155 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:35.086940 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:35.087371 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:35.224970 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:35.232276 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-de0d8298-2b1c-4845-812d-d0f2152273ef tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.157512 Jun 25 00:04:35.232882 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 562/1143] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:35 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:36.249840 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:36.250372 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:36.257507 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:36.257951 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:36.258727 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:36.259156 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:36.390322 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:36.398000 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-9d9597a4-3dd2-47c4-92e1-bc625b622a76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.152113 Jun 25 00:04:36.398548 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 582/1144] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:36 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:37.414242 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:37.414849 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:37.416729 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=2 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:37.422330 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:37.422777 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:37.423537 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:37.423966 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:37.553439 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:37.560878 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-d4eb7c20-787e-45ce-a820-b1036769654a tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.150461 Jun 25 00:04:37.561436 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 563/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:37 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:38.578417 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:38.579031 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:38.581967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell0:SELECT=4 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:38.587718 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:38.588169 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:38.589030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:38.589465 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:38.721628 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:38.729014 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-af7fa1f9-0ec0-4133-b85d-cf4e6d97edde tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.154484 Jun 25 00:04:38.729575 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 583/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:38 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:39.745967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:39.746516 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:39.748794 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell0:SELECT=10 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:04:39.755210 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:39.755654 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:39.756404 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:39.756865 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:39.889943 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:39.898199 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-419b56b9-6b0c-47b6-9c60-e14bba1d3189 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.156226 Jun 25 00:04:39.898748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 564/1147] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:39 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:40.914908 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:40.915526 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:40.922370 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:40.922867 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:40.923672 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:40.924157 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:41.055281 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:41.062639 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-77cb7b6c-7496-4614-bf0e-bc7b7cc6f048 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.151587 Jun 25 00:04:41.063189 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 584/1148] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:40 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:42.079359 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:42.079967 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:42.086721 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:42.087169 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:42.087925 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:42.088355 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:42.215704 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:42.223434 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-05d4bd55-e55b-4d5f-876b-6f16338e1a91 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.147947 Jun 25 00:04:42.223989 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 565/1149] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:42 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:43.241081 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:43.242036 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:43.248523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:43.248997 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:43.249752 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:43.250182 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:43.274393 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [req-977fb792-165b-436e-a228-d4102a7aa7c1 req-2ee67343-c656-460d-873f-9f6113dd8e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f736e33c-085c-40bf-ba13-828a757ef334", "name": "network-vif-plugged", "status": "completed", "tag": "2d011638-71b2-4f9b-92c8-9a76a475039c"}]} {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:04:43.283934 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-977fb792-165b-436e-a228-d4102a7aa7c1 req-2ee67343-c656-460d-873f-9f6113dd8e9a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:43.284464 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [req-977fb792-165b-436e-a228-d4102a7aa7c1 req-2ee67343-c656-460d-873f-9f6113dd8e9a service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:43.298107 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.compute.server_external_events [req-977fb792-165b-436e-a228-d4102a7aa7c1 req-2ee67343-c656-460d-873f-9f6113dd8e9a service nova] Creating event network-vif-plugged:2d011638-71b2-4f9b-92c8-9a76a475039c for instance f736e33c-085c-40bf-ba13-828a757ef334 on hv-cinder-84762 Jun 25 00:04:43.303394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [req-977fb792-165b-436e-a228-d4102a7aa7c1 req-2ee67343-c656-460d-873f-9f6113dd8e9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Jun 25 00:04:43.304149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 566/1150] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 00:04:43.394683 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:43.402343 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-d827ad58-6e68-4c78-8ede-73a900acda96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.166661 Jun 25 00:04:43.402883 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 585/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:43 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:44.419631 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:44.420329 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:44.427230 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:44.427681 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:44.428443 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:44.428908 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:44.557535 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:44.565857 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-53861878-1946-478e-ac85-82fdb3b4e2d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1263 microversion: 2.1 time: 0.150068 Jun 25 00:04:44.566154 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 567/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:44 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:45.583498 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:45.584198 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:45.591223 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:45.591752 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:45.592521 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:45.592984 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:45.724853 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:45.732177 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a91de61b-11c6-4bb4-b888-152d6731a46e tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1449 microversion: 2.1 time: 0.153690 Jun 25 00:04:45.732758 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 586/1153] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:45 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:45.748272 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:04:45.748912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:04:45.755860 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:45.756302 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:45.757084 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:45.757519 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:45.884999 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:04:45.892400 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-8c70a94a-d757-40d4-9aa5-feb3351b1f96 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1449 microversion: 2.1 time: 0.147899 Jun 25 00:04:45.893029 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 568/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:04:45 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:04:47.566199 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-62ddca27-7052-4611-801f-ac5db819189a req-8641d4df-b5ac-443b-8154-cb8cb7cd9911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f736e33c-085c-40bf-ba13-828a757ef334", "tag": "2d011638-71b2-4f9b-92c8-9a76a475039c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:04:47.574326 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-62ddca27-7052-4611-801f-ac5db819189a req-8641d4df-b5ac-443b-8154-cb8cb7cd9911 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:04:47.574841 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-62ddca27-7052-4611-801f-ac5db819189a req-8641d4df-b5ac-443b-8154-cb8cb7cd9911 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:04:47.586299 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-62ddca27-7052-4611-801f-ac5db819189a req-8641d4df-b5ac-443b-8154-cb8cb7cd9911 service nova] Creating event network-changed:2d011638-71b2-4f9b-92c8-9a76a475039c for instance f736e33c-085c-40bf-ba13-828a757ef334 on hv-cinder-84762 Jun 25 00:04:47.591404 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-62ddca27-7052-4611-801f-ac5db819189a req-8641d4df-b5ac-443b-8154-cb8cb7cd9911 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094736 Jun 25 00:04:47.592016 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 587/1155] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:05:27.849977 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:05:27.850704 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:05:37.266061 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:05:37.266658 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Sat Jun 25 00:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:06:15.830891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:06:15.831705 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG dbcounter [-] [124093] Writing DB stats nova_cell1:SELECT=52 {{(pid=124093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:06:15.834681 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_api:SELECT=26 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:06:15.835536 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG dbcounter [-] [124092] Writing DB stats nova_cell1:SELECT=46 {{(pid=124092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 00:06:15.836639 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:15.837149 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:15.847065 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:15.847748 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:15.848540 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:15.849085 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:15.877318 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 00:06:15.902398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-d701ce20-6aa3-4d95-8ba4-b7b8571539b5 req-0319537f-7259-4d64-91da-6f54d346ad26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f736e33c-085c-40bf-ba13-828a757ef334", "tag": "2d011638-71b2-4f9b-92c8-9a76a475039c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:06:15.911062 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d701ce20-6aa3-4d95-8ba4-b7b8571539b5 req-0319537f-7259-4d64-91da-6f54d346ad26 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:15.911501 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-d701ce20-6aa3-4d95-8ba4-b7b8571539b5 req-0319537f-7259-4d64-91da-6f54d346ad26 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:15.924101 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-d701ce20-6aa3-4d95-8ba4-b7b8571539b5 req-0319537f-7259-4d64-91da-6f54d346ad26 service nova] Creating event network-changed:2d011638-71b2-4f9b-92c8-9a76a475039c for instance f736e33c-085c-40bf-ba13-828a757ef334 on hv-cinder-84762 Jun 25 00:06:15.930173 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-d701ce20-6aa3-4d95-8ba4-b7b8571539b5 req-0319537f-7259-4d64-91da-6f54d346ad26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098186 Jun 25 00:06:15.930978 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 588/1156] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:06:15.969482 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-5aab9269-190f-470d-89b1-96b061925795 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 204 len: 0 microversion: 2.1 time: 0.139307 Jun 25 00:06:15.971378 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 569/1157] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jun 25 00:06:15 2022] DELETE /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 00:06:15.982663 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:15.983397 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:15.991543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:15.992434 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:15.992795 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:15.993229 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:16.131361 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:16.139103 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-cc4261a0-4707-4582-aec8-7acb831c7179 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1574 microversion: 2.1 time: 0.162321 Jun 25 00:06:16.139664 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 589/1158] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:15 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:17.159071 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:17.159682 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:17.167288 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:17.167738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:17.168511 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:17.168972 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:17.336954 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:17.344890 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-f2cde47f-8ce7-4519-b551-6436b6fb9fb3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1574 microversion: 2.1 time: 0.190097 Jun 25 00:06:17.345867 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 570/1159] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:17 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:18.272028 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-01704bc9-ceee-4183-a358-44af185ac1df req-f8eeae2f-32aa-4b7b-b1ac-6197bf6bbf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f736e33c-085c-40bf-ba13-828a757ef334", "name": "network-vif-deleted", "tag": "2d011638-71b2-4f9b-92c8-9a76a475039c"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:06:18.281020 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-01704bc9-ceee-4183-a358-44af185ac1df req-f8eeae2f-32aa-4b7b-b1ac-6197bf6bbf00 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:18.281464 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-01704bc9-ceee-4183-a358-44af185ac1df req-f8eeae2f-32aa-4b7b-b1ac-6197bf6bbf00 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:18.293657 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-01704bc9-ceee-4183-a358-44af185ac1df req-f8eeae2f-32aa-4b7b-b1ac-6197bf6bbf00 service nova] Creating event network-vif-deleted:2d011638-71b2-4f9b-92c8-9a76a475039c for instance f736e33c-085c-40bf-ba13-828a757ef334 on hv-cinder-84762 Jun 25 00:06:18.300693 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-01704bc9-ceee-4183-a358-44af185ac1df req-f8eeae2f-32aa-4b7b-b1ac-6197bf6bbf00 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Jun 25 00:06:18.301866 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 590/1160] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:06:18.362819 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:18.363940 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:18.370381 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:18.370916 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:18.371806 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:18.372284 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:18.442749 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:18.450158 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-6ff86613-ccbc-47a7-aaf0-6039eb59cb97 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 200 len: 1224 microversion: 2.1 time: 0.091414 Jun 25 00:06:18.450711 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 571/1161] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:18 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:19.468410 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:19.469136 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: f736e33c-085c-40bf-ba13-828a757ef334] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:19.476474 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:19.476937 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:19.486090 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:19.486524 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:19.499675 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] HTTP exception thrown: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Request method failure captured: Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 HTTP/1.1 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk_z2sFqJu04pXwhxozQTuMEScjk4Lj2qOGMDogtwmlzvYEEtsVR8Q2XuZYkf-860G_YdHqSTyp4631mVUCTkLvLcGJjr16JO_EuYmpxcNVyPgGNu9jTyvGbGs43Rx012bukAR7OFn2wAw_oW6HhsWzLFdl6WyJiSYwl77qrJQCnaqU Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 25 00:06:19.502651 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}] Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: bd94685199f44a218dd96397b02cdc39 Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. Jun 25 00:06:19.504621 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': 'f736e33c-085c-40bf-ba13-828a757ef334'} Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 00:06:19.506149 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. Jun 25 00:06:19.507855 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:19.509746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Returning 404 to user: Instance f736e33c-085c-40bf-ba13-828a757ef334 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 00:06:19.509746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-bf4f1bf7-dc65-43f8-9165-14a7e53b9225 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334" status: 404 len: 111 microversion: 2.1 time: 0.040563 Jun 25 00:06:19.509746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 591/1162] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:19 2022] GET /compute/v2.1/servers/f736e33c-085c-40bf-ba13-828a757ef334 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 00:06:22.792078 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:22.792692 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:22.794497 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-da3f3eaf-6808-4c13-9f77-d411eb7cd90e req-3c693dbe-656b-423c-9d79-825ce00a40f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d7008c-aac5-429c-95ed-c0d657b171b0", "tag": "ed699f34-9911-4658-ba30-242a66cb008e"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:06:22.799811 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:22.800012 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:22.800982 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:22.801620 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:22.803699 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-da3f3eaf-6808-4c13-9f77-d411eb7cd90e req-3c693dbe-656b-423c-9d79-825ce00a40f9 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:22.804213 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-da3f3eaf-6808-4c13-9f77-d411eb7cd90e req-3c693dbe-656b-423c-9d79-825ce00a40f9 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:22.815722 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-da3f3eaf-6808-4c13-9f77-d411eb7cd90e req-3c693dbe-656b-423c-9d79-825ce00a40f9 service nova] Creating event network-changed:ed699f34-9911-4658-ba30-242a66cb008e for instance 02d7008c-aac5-429c-95ed-c0d657b171b0 on hv-cinder-84762 Jun 25 00:06:22.821598 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-da3f3eaf-6808-4c13-9f77-d411eb7cd90e req-3c693dbe-656b-423c-9d79-825ce00a40f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 Jun 25 00:06:22.822595 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 592/1163] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 00:06:22.829524 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Going to try to terminate instance {{(pid=124093) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 00:06:22.920022 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-ec7c8d32-d461-456c-b2dd-61582536b192 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 204 len: 0 microversion: 2.1 time: 0.131663 Jun 25 00:06:22.927007 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 572/1164] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jun 25 00:06:22 2022] DELETE /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 00:06:22.935461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:22.935461 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:22.943525 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:22.943811 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:22.944676 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:22.945206 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:23.083738 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.policy [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:23.091187 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-b44aec1b-bb50-4b4f-9ab7-9e7b6e9449c5 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1572 microversion: 2.1 time: 0.165312 Jun 25 00:06:23.091746 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 593/1165] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:22 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:24.110183 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:24.110891 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:24.118086 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:24.118542 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:24.119325 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:24.119765 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:24.290397 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:24.297991 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-df3fb248-9ff7-4c79-bc26-c5edee3c4c6f tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1572 microversion: 2.1 time: 0.192076 Jun 25 00:06:24.298549 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 573/1166] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:24 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:25.210029 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [req-bf2319cc-f381-4711-981e-a5857920cf55 req-21bc46e8-0d32-4075-b1a8-17d44e7ba939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d7008c-aac5-429c-95ed-c0d657b171b0", "name": "network-vif-deleted", "tag": "ed699f34-9911-4658-ba30-242a66cb008e"}]} {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 00:06:25.218528 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bf2319cc-f381-4711-981e-a5857920cf55 req-21bc46e8-0d32-4075-b1a8-17d44e7ba939 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:25.218967 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [req-bf2319cc-f381-4711-981e-a5857920cf55 req-21bc46e8-0d32-4075-b1a8-17d44e7ba939 service nova] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:25.230556 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.compute.server_external_events [req-bf2319cc-f381-4711-981e-a5857920cf55 req-21bc46e8-0d32-4075-b1a8-17d44e7ba939 service nova] Creating event network-vif-deleted:ed699f34-9911-4658-ba30-242a66cb008e for instance 02d7008c-aac5-429c-95ed-c0d657b171b0 on hv-cinder-84762 Jun 25 00:06:25.235732 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [req-bf2319cc-f381-4711-981e-a5857920cf55 req-21bc46e8-0d32-4075-b1a8-17d44e7ba939 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030535 Jun 25 00:06:25.236327 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 594/1167] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jun 25 00:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 00:06:25.315986 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:25.317373 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:25.323727 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:25.324175 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:25.324961 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:25.325394 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:25.389247 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.policy [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94685199f44a218dd96397b02cdc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10b8a1bc1654ae4ac5c08c23ca9e399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124093) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 00:06:25.397306 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-9d3c055b-8fb7-48d7-a792-01b546521b76 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 200 len: 1223 microversion: 2.1 time: 0.085494 Jun 25 00:06:25.397950 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 574/1168] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:25 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 00:06:26.416398 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:26.417122 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 02d7008c-aac5-429c-95ed-c0d657b171b0] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:26.423350 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.423794 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.424543 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.425001 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.437811 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] HTTP exception thrown: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Request method failure captured: Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 HTTP/1.1 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk_z2sFqJu04pXwhxozQTuMEScjk4Lj2qOGMDogtwmlzvYEEtsVR8Q2XuZYkf-860G_YdHqSTyp4631mVUCTkLvLcGJjr16JO_EuYmpxcNVyPgGNu9jTyvGbGs43Rx012bukAR7OFn2wAw_oW6HhsWzLFdl6WyJiSYwl77qrJQCnaqU Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 25 00:06:26.439425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}] Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: bd94685199f44a218dd96397b02cdc39 Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. Jun 25 00:06:26.441943 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '02d7008c-aac5-429c-95ed-c0d657b171b0'} Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 00:06:26.442912 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. Jun 25 00:06:26.444523 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.446030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Returning 404 to user: Instance 02d7008c-aac5-429c-95ed-c0d657b171b0 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 00:06:26.446030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-c7766dc7-cfc2-4776-901d-1d9c32bbfee8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0" status: 404 len: 111 microversion: 2.1 time: 0.029262 Jun 25 00:06:26.446030 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 595/1169] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:26 2022] GET /compute/v2.1/servers/02d7008c-aac5-429c-95ed-c0d657b171b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 00:06:26.875379 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:26.875912 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.compute.api [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124093) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:26.883385 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.883828 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.884603 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.885052 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG oslo_concurrency.lockutils [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.898013 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.wsgi [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] HTTP exception thrown: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Request method failure captured: Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: request: DELETE /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 HTTP/1.1 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept: application/json Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Accept-Encoding: identity Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Connection: close Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Length: 0 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Content-Type: application/json Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Host: 10.222.0.47 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Openstack-System-Scope: None Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: User-Agent: python-urllib3/1.26.9 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Auth-Token: gAAAAABitk_z2sFqJu04pXwhxozQTuMEScjk4Lj2qOGMDogtwmlzvYEEtsVR8Q2XuZYkf-860G_YdHqSTyp4631mVUCTkLvLcGJjr16JO_EuYmpxcNVyPgGNu9jTyvGbGs43Rx012bukAR7OFn2wAw_oW6HhsWzLFdl6WyJiSYwl77qrJQCnaqU Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Id: None Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Domain-Name: None Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Identity-Status: Confirmed Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Is-Admin-Project: True Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Id: default Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Domain-Name: Default Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Project-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Role: reader,member Jun 25 00:06:26.899909 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Roles: reader,member Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}] Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-Tenant-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Id: default Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Domain-Name: Default Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Id: bd94685199f44a218dd96397b02cdc39 Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: X-User-Name: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: method: > Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: exception: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.901738 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: action_args: {'id': '54e76b40-abc1-4a87-8af4-518dfea01db4'} Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 00:06:26.902586 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.903920 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.905694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Returning 404 to user: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. {{(pid=124093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 00:06:26.905694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-0678d300-a7aa-4392-8777-3f76fa7f4e7b tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 404 len: 111 microversion: 2.1 time: 0.029946 Jun 25 00:06:26.905694 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 575/1170] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jun 25 00:06:26 2022] DELETE /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 00:06:26.909857 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '>' {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:26.911059 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.compute.api [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] [instance: 54e76b40-abc1-4a87-8af4-518dfea01db4] Fetching instance by UUID {{(pid=124092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 00:06:26.917018 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.917466 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.918221 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 00:06:26.918656 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG oslo_concurrency.lockutils [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Lock "5615ae4e-5e2b-4e7f-89df-a16968d1ea83" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 00:06:26.934481 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.wsgi [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] HTTP exception thrown: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Request method failure captured: Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: request: GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 HTTP/1.1 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept: application/json Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Accept-Encoding: identity Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Connection: close Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Length: 0 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Content-Type: application/json Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Host: 10.222.0.47 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Openstack-System-Scope: None Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: User-Agent: python-urllib3/1.26.9 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Auth-Token: gAAAAABitk_z2sFqJu04pXwhxozQTuMEScjk4Lj2qOGMDogtwmlzvYEEtsVR8Q2XuZYkf-860G_YdHqSTyp4631mVUCTkLvLcGJjr16JO_EuYmpxcNVyPgGNu9jTyvGbGs43Rx012bukAR7OFn2wAw_oW6HhsWzLFdl6WyJiSYwl77qrJQCnaqU Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Id: None Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Domain-Name: None Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Identity-Status: Confirmed Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Is-Admin-Project: True Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Id: default Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Domain-Name: Default Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Project-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Role: reader,member Jun 25 00:06:26.936024 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Roles: reader,member Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f10b8a1bc1654ae4ac5c08c23ca9e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f10b8a1bc1654ae4ac5c08c23ca9e399"}]}] Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Id: f10b8a1bc1654ae4ac5c08c23ca9e399 Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1378987964 Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Id: default Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Domain-Name: Default Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Id: bd94685199f44a218dd96397b02cdc39 Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: X-User-Name: tempest-TestVolumeBootPattern-1378987964-project Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: method: > Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: exception: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.937583 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: action_args: {'id': '54e76b40-abc1-4a87-8af4-518dfea01db4'} Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: {{(pid=124092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 00:06:26.938616 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. Jun 25 00:06:26.940252 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: ERROR nova.api.openstack.wsgi Jun 25 00:06:26.942290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: DEBUG nova.api.openstack.wsgi [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Returning 404 to user: Instance 54e76b40-abc1-4a87-8af4-518dfea01db4 could not be found. {{(pid=124092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 00:06:26.942290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO nova.api.openstack.requestlog [None req-a80e1cfe-f216-4c15-8f4b-9a0d82ecd7d3 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4" status: 404 len: 111 microversion: 2.1 time: 0.031449 Jun 25 00:06:26.942290 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: [pid: 124092|app: 0|req: 596/1171] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jun 25 00:06:26 2022] GET /compute/v2.1/servers/54e76b40-abc1-4a87-8af4-518dfea01db4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 00:06:28.233399 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: DEBUG nova.api.openstack.wsgi [None req-e767d6e2-05ef-4027-92da-07f04d33f2a8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] Calling method '.version_select at 0x7f7a559f4940>' {{(pid=124093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 00:06:28.258089 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO nova.api.openstack.requestlog [None req-e767d6e2-05ef-4027-92da-07f04d33f2a8 tempest-TestVolumeBootPattern-1378987964 tempest-TestVolumeBootPattern-1378987964-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-740810056" status: 202 len: 0 microversion: 2.1 time: 0.028539 Jun 25 00:06:28.259186 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: [pid: 124093|app: 0|req: 576/1172] 10.222.0.47 () {58 vars in 1259 bytes} [Sat Jun 25 00:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-740810056 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 00:07:17.243563 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:07:17.244148 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:08:47.857859 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:08:47.858587 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:08:57.276103 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:08:57.276715 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Sat Jun 25 00:08:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:09:13.491254 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:09:13.491910 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Sat Jun 25 00:09:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:09:14.505655 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:09:14.506061 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:10:31.199930 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:10:31.200521 dv-cinder-847624-1-iscsi devstack@n-api.service[124093]: Sat Jun 25 00:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 00:10:37.251425 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 00:10:37.251985 dv-cinder-847624-1-iscsi devstack@n-api.service[124092]: Sat Jun 25 00:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!